-- Logs begin at Mon 2022-08-08 01:28:01 UTC, end at Mon 2022-08-08 02:49:04 UTC. -- Aug 08 02:17:57.449613 dv-cinder-733062-33-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 08 02:17:57.458672 dv-cinder-733062-33-smb devstack@keystone.service[80201]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 02:17:57 2022] *** Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: nodename: dv-cinder-733062-33-smb Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: machine: x86_64 Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: clock source: unix Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: pcre jit disabled Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: detected number of CPU cores: 4 Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: current working directory: / Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: detected binary path: /usr/bin/uwsgi-core Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: your processes number limit is 47680 Aug 08 02:17:57.460772 dv-cinder-733062-33-smb devstack@keystone.service[80201]: your memory page size is 4096 bytes Aug 08 02:17:57.461349 dv-cinder-733062-33-smb devstack@keystone.service[80201]: detected max file descriptor number: 2048 Aug 08 02:17:57.461349 dv-cinder-733062-33-smb devstack@keystone.service[80201]: lock engine: pthread robust mutexes Aug 08 02:17:57.461349 dv-cinder-733062-33-smb devstack@keystone.service[80201]: thunder lock: enabled Aug 08 02:17:57.461349 dv-cinder-733062-33-smb devstack@keystone.service[80201]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 08 02:17:57.461349 dv-cinder-733062-33-smb devstack@keystone.service[80201]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 02:17:57.499628 dv-cinder-733062-33-smb devstack@keystone.service[80201]: Python main interpreter initialized at 0x5581320ae9c0 Aug 08 02:17:57.499628 dv-cinder-733062-33-smb devstack@keystone.service[80201]: python threads support enabled Aug 08 02:17:57.499628 dv-cinder-733062-33-smb devstack@keystone.service[80201]: your server socket listen backlog is limited to 100 connections Aug 08 02:17:57.499628 dv-cinder-733062-33-smb devstack@keystone.service[80201]: your mercy for graceful operations on workers is 90 seconds Aug 08 02:17:57.500023 dv-cinder-733062-33-smb devstack@keystone.service[80201]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 02:17:57.500023 dv-cinder-733062-33-smb devstack@keystone.service[80201]: *** Operational MODE: preforking *** Aug 08 02:17:57.500307 dv-cinder-733062-33-smb devstack@keystone.service[80201]: *** uWSGI is running in multiple interpreter mode *** Aug 08 02:17:57.500307 dv-cinder-733062-33-smb devstack@keystone.service[80201]: spawned uWSGI master process (pid: 80201) Aug 08 02:17:57.500481 dv-cinder-733062-33-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 08 02:17:57.502137 dv-cinder-733062-33-smb devstack@keystone.service[80201]: spawned uWSGI worker 1 (pid: 80213, cores: 1) Aug 08 02:17:57.502137 dv-cinder-733062-33-smb devstack@keystone.service[80201]: spawned uWSGI worker 2 (pid: 80214, cores: 1) Aug 08 02:17:57.502137 dv-cinder-733062-33-smb devstack@keystone.service[80201]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 02:18:02.936066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:18:02.936066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: from cryptography.utils import int_from_bytes Aug 08 02:18:02.936860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:18:02.936860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes Aug 08 02:18:02.937259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:18:02.937259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: from cryptography.utils import int_from_bytes Aug 08 02:18:02.937380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:18:02.937380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes Aug 08 02:18:02.985832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:18:02.986029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:18:02.986120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:18:02.986191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:18:02.986255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] command line args: [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:18:02.986401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] command line args: [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:18:02.986532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:18:02.986624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ================================================================================ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:18:02.986698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:18:02.986879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ================================================================================ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:18:02.987009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] admin_token = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config_dir = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] config_dir = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config_source = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] debug = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.987925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] config_source = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.988038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.988279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] debug = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.988279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.988476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.988549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.988671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.988757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_config_append = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.989977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] log_config_append = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_dir = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] log_dir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] log_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.990974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.991148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.991260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.991370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.991564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.991731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.991851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.991966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992077 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.992998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.993105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.993218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.993333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.993551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.993727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.993861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.993975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.994116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.994233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.994521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.994705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.995098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.995266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.995404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] publish_errors = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.995526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] publish_errors = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.995643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.995776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.995883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.996975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] standard_threads = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.997132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] standard_threads = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.997249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.997456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.997578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.997693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.997803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.997917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] use_journal = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_journal = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] use_json = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_json = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] use_stderr = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_stderr = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] use_syslog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_syslog = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.998942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.999057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:18:02.999167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:02.999280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:02.999398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:02.999515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:02.999708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:02.999882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.000010 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.000123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.000354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.000543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.000668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.000782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.001004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.001177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.001297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.001457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.001643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.001767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.001983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.002103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.002311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.002434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.002620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.002741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.002929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.003097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.003241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.003432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.003549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.003790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.003915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.004994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.005113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.005251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.005504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.005616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.005806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.005930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.006926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.007966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.008932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.009982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.010931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.011920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.012027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.012142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.012257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.012399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.012689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.012855 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.013794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.014900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015010 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.015889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.016979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.017938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.018893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.019986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.020930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.021940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.022971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.023966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.external = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.024858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.external = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.password = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.025894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.token = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.password = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.token = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.027942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.028146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.028318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.028501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.028688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.028825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.028935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.029984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.030989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.031893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.032957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.033993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.034904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.035977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.036973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.037156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.037269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.037449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.037564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.037675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.037784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.037893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.038905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.039907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.040919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041137 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.041929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.042927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.043036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.043145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.043253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.043363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.043480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.043596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.043813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.044933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.045903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.046905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.047907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.048914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.049959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.050951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.051968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052077 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.052958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.053999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.054988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.055934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.056976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] role.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] role.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.057984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058316 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.058981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.059089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.059207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.059441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.059575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.059685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.059795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.059905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.060983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.061096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.061232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.061346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.061520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.061632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.061742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.061893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.062945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.063903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.064983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065099 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.065946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066881 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.066994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.067103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.067220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.067356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.067468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.067601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.067726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.067926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.068931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.069985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.070920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.071925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.072923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.073954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.074064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.074173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.074282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:18:03.074391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.074507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.074736 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:18:03.074967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:18:03.104622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.104891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.105091 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.108899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.109132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.109359 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.115267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.119275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.143833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.144069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.145589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.145823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.196608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.196899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.247108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.247318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.247936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.248169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.311964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.312043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.312106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.312238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.312385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.335540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.335743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.335835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.335977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.336879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.337076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.348023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.348279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.360751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.361877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.362019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.362097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.362172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.362327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.362537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:18:03.378931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.379115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:18:03.379249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.379474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.379598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:18:03.379675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:18:03.379889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.380017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.380152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:18:03.380231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.380291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.380418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.380497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.380671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.380794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.381030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.392049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.392327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.392449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.392592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.392786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.392908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.393052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.393284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.399718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.400169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.402776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.403100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.403299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.403423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.403586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.403708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.403844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.403940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.404161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.404289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.404489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.404614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.404760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.404842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.404977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.405100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.405235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.405326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.405531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.405653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.405789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.406063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.428420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.428898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.429935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.430227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.430419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.430708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.434844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.435126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.435409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.435533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.435668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.435978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.441923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.442189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.442673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.442964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.446196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.446489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.446833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.447042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.447165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.447292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.447386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.447586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.447709 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.447843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.447922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.448115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.448252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.448387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.448691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.448961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.464023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.464297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.465196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.465526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.468302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.469695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.471457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.471751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.472829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.473125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.476105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.477512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.479281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.480671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.482568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.482868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.483155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.483441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.483716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.483876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.483970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.484205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.484493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.484780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.485061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.485361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.499960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.500227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.500531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.500795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.501244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.501563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.501834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.502097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.507642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.508921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.509198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.509507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.510506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.510796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.512289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.512631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.512921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.513218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.513524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.513774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.514052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.514359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.514654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.514916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.524823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.525105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.525397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.525694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.525979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.526255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.526377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.526484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.526552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.526821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.527107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.527393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.527678 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.527961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.543091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.544506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.546210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.547477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.549115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.550425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.550708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.551994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.552196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.552475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.552773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.553514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.553807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.554096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.559136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.560497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.560772 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.562150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.563712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.564003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.564293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.564572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.565078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.565398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.565687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.565963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.572700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.572993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.573278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.574064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.574360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.574642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.580685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.580973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.581251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.581555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.581828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.581952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:18:03.582094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.582175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.582376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.582502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.582650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.582733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.582972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.583109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.583246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.583336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.583503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.583593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.583780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.583958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.584043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.584118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.584317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.584443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.584695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.584972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.585254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.585528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:18:03.618111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581320ae9c0 pid: 80213 (default app) Aug 08 02:18:03.618729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581320ae9c0 pid: 80214 (default app) Aug 08 02:18:03.620617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc87c4-a765-4d08-80b5-507fa42726d6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:03.620907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc87c4-a765-4d08-80b5-507fa42726d6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:03.621183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc87c4-a765-4d08-80b5-507fa42726d6 None None] PATH_INFO: `/v3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:03.625613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Mon Aug 8 02:18:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:11.460182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f19ac-7bf3-423f-a782-c87e8504e0f4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:11.460820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f19ac-7bf3-423f-a782-c87e8504e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:11.460820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f19ac-7bf3-423f-a782-c87e8504e0f4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:11.465222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:11.471873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:11.472607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:11.472758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:11.545732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: INFO dbcounter [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] Registered counter for database keystone Aug 08 02:18:11.568071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG oslo_db.sqlalchemy.engines [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:18:11.577889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writer thread running {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:18:11.757465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG passlib.handlers.bcrypt [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80213) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 02:18:11.757803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG passlib.handlers.bcrypt [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80213) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 02:18:11.815017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:11.816639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:11.949766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 02:18:12.118331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f19ac-7bf3-423f-a782-c87e8504e0f4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:12.192680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: INFO dbcounter [None req-5b1f19ac-7bf3-423f-a782-c87e8504e0f4 None None] Registered counter for database keystone Aug 08 02:18:12.217408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1f19ac-7bf3-423f-a782-c87e8504e0f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:18:12.224379 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writer thread running {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:18:12.343695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f19ac-7bf3-423f-a782-c87e8504e0f4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:12.349060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7f8bb-b1b0-42d4-b3a1-da6338932a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:12.349718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7f8bb-b1b0-42d4-b3a1-da6338932a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:12.349970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7f8bb-b1b0-42d4-b3a1-da6338932a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:12.350261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7f8bb-b1b0-42d4-b3a1-da6338932a21 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:12.359131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7f8bb-b1b0-42d4-b3a1-da6338932a21 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:12.410521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8b7f8bb-b1b0-42d4-b3a1-da6338932a21 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 02:18:12.410795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7f8bb-b1b0-42d4-b3a1-da6338932a21 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:12.421050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Mon Aug 8 02:18:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:18:12.430942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:12.454247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a614a3-c9b3-43de-b4e8-0d933618576e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:12.462526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dedb2e-dbac-463e-b0a8-3c3857f89900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:12.464191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dedb2e-dbac-463e-b0a8-3c3857f89900 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:12.464546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dedb2e-dbac-463e-b0a8-3c3857f89900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:12.464878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dedb2e-dbac-463e-b0a8-3c3857f89900 admin admin] PATH_INFO: `/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:12.467716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dedb2e-dbac-463e-b0a8-3c3857f89900 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6ce53165eb847a3be1e8ef59c28b2a1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:12.522824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f3dedb2e-dbac-463e-b0a8-3c3857f89900 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 02:18:12.523406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dedb2e-dbac-463e-b0a8-3c3857f89900 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:12.528051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Aug 8 02:18:12 2022] GET /identity/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:14.522298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a7a3-7eff-407e-b21a-28435b7c0d54 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:14.522858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a7a3-7eff-407e-b21a-28435b7c0d54 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:14.522858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a7a3-7eff-407e-b21a-28435b7c0d54 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:14.526967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:14.533800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079726d-3ec6-4a54-af4f-32eb45ab7ffc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:14.534232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079726d-3ec6-4a54-af4f-32eb45ab7ffc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:14.534369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079726d-3ec6-4a54-af4f-32eb45ab7ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:14.561844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e079726d-3ec6-4a54-af4f-32eb45ab7ffc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:14.563371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e079726d-3ec6-4a54-af4f-32eb45ab7ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:14.573895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 02:18:14.596729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a7a3-7eff-407e-b21a-28435b7c0d54 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:14.612931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a7a3-7eff-407e-b21a-28435b7c0d54 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:14.618244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd785-cc98-4557-ad5f-92dca5378058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:14.618859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd785-cc98-4557-ad5f-92dca5378058 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:14.619169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd785-cc98-4557-ad5f-92dca5378058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:14.619441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd785-cc98-4557-ad5f-92dca5378058 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:14.628562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bd785-cc98-4557-ad5f-92dca5378058 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:14.630412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bd785-cc98-4557-ad5f-92dca5378058 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:14.640339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Mon Aug 8 02:18:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:18:14.646715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079726d-3ec6-4a54-af4f-32eb45ab7ffc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:14.661192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079726d-3ec6-4a54-af4f-32eb45ab7ffc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:14.669810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feacc06-76ac-48f0-ba80-510f563137a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:14.670444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feacc06-76ac-48f0-ba80-510f563137a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:14.670725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feacc06-76ac-48f0-ba80-510f563137a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:14.670990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feacc06-76ac-48f0-ba80-510f563137a9 admin admin] PATH_INFO: `/v3/users/55725fd30c284e01b807aa482bab0655` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:14.672477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feacc06-76ac-48f0-ba80-510f563137a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=55725fd30c284e01b807aa482bab0655)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:14.674380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feacc06-76ac-48f0-ba80-510f563137a9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:14.675889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Mon Aug 8 02:18:14 2022] GET /identity/v3/users/55725fd30c284e01b807aa482bab0655 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:16.705560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b3d8-6b9c-496e-a9cd-87639325d47a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:16.706092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b3d8-6b9c-496e-a9cd-87639325d47a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:16.706092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b3d8-6b9c-496e-a9cd-87639325d47a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:16.707455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:16.712707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553bb6-17fe-4d03-bd0c-31342ae3943e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:16.713155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553bb6-17fe-4d03-bd0c-31342ae3943e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:16.713262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553bb6-17fe-4d03-bd0c-31342ae3943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:16.730604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb4d3-9838-4df7-8daa-8a17a01092f7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:16.730881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb4d3-9838-4df7-8daa-8a17a01092f7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:16.731157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb4d3-9838-4df7-8daa-8a17a01092f7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:16.732727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-26553bb6-17fe-4d03-bd0c-31342ae3943e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:16.732865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:16.733804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-26553bb6-17fe-4d03-bd0c-31342ae3943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:16.737220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:16.737530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:16.737806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:16.780791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80214) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 02:18:16.781211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80214) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 02:18:16.819534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:16.826670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:16.828258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:16.843032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553bb6-17fe-4d03-bd0c-31342ae3943e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:16.868296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:16.928006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:16.948246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553bb6-17fe-4d03-bd0c-31342ae3943e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:16.949702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:16.983103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:16.983748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:16.984030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:16.984304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:16.995624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:17.004528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:17.005421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:17.006408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:18:17.011484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:17.051822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d1d8-11bf-4593-bd60-f46dba5dfb53 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:17.054170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:17.090182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:17.091291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:17.091593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:17.091867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:17.092905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:17.111224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a3a7-6c11-400b-a6c9-c39bb6df8e28 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:17.146548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:17.147181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:17.147435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:17.147710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:17.148378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:17.148689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:17.150128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:17.159815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:17.161338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:17.161696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:17.167224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:17.268437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:18:17.274261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:17.277569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:17.377861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d440d2-c0e5-4119-8824-9369ad1a3731 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:17.383737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8009-837f-422b-8dbd-abc9a2eb7543 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:17.411732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:17.412620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:17.412901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:17.413174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:17.417626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:17.418268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:17.418549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:17.418823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] PATH_INFO: `/v3/users/55725fd30c284e01b807aa482bab0655` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:17.420485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] RBAC: Authorizing `identity:get_user(user_id=55725fd30c284e01b807aa482bab0655)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:17.421989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:17.423580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:17 2022] GET /identity/v3/users/55725fd30c284e01b807aa482bab0655 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:17.429045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:17.431325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:17.432807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:17.443771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:18:17.452759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:17.453843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:18:17.454609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:18:17.454609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:18:17.454609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:17.454609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:18:17.459760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:17.514954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:17.530029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e64cd-1c54-49bf-af53-e0ac7213117a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:17.558434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1f644-f388-4f08-b7d0-61e9d5f532ca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:17.563566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:17.564208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:17.564489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:17.564764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:17.565932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:17.567419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:17.569000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:17.574745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:17.591770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb818c-c24c-4995-bc78-e8107c1e7f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:17.592378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb818c-c24c-4995-bc78-e8107c1e7f23 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:17.592657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb818c-c24c-4995-bc78-e8107c1e7f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:17.592907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb818c-c24c-4995-bc78-e8107c1e7f23 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:17.593602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb818c-c24c-4995-bc78-e8107c1e7f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:17.593876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb818c-c24c-4995-bc78-e8107c1e7f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:17.595269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb818c-c24c-4995-bc78-e8107c1e7f23 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:17.612804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:17.663335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:17.685502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a6883-525b-4cff-8100-846e66d12f7c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:17.723192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1962-c35b-4236-ac0e-76710216a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:17.723860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1962-c35b-4236-ac0e-76710216a25c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:17.724089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1962-c35b-4236-ac0e-76710216a25c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:17.724364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1962-c35b-4236-ac0e-76710216a25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:17.725108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b1962-c35b-4236-ac0e-76710216a25c None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.domain.id=default, user.id=55725fd30c284e01b807aa482bab0655) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:17.725416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b1962-c35b-4236-ac0e-76710216a25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:17.726958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b1962-c35b-4236-ac0e-76710216a25c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:17.734830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Mon Aug 8 02:18:17 2022] GET /identity/v3/role_assignments?user.id=55725fd30c284e01b807aa482bab0655&scope.domain.id=default&role.id=1470302d39e340299072b424021b764b => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:19.796682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f52bf-5c13-45c2-915d-f90da94276f8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:19.797222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f52bf-5c13-45c2-915d-f90da94276f8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:19.797222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f52bf-5c13-45c2-915d-f90da94276f8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:19.798878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:19.803911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c49c1-ce65-4ce2-82bd-eada0c27b4ab None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:19.804298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c49c1-ce65-4ce2-82bd-eada0c27b4ab None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:19.804478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c49c1-ce65-4ce2-82bd-eada0c27b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:19.828766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-896c49c1-ce65-4ce2-82bd-eada0c27b4ab None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:19.829991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-896c49c1-ce65-4ce2-82bd-eada0c27b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:19.922564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:19.959704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f52bf-5c13-45c2-915d-f90da94276f8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:20.089922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f52bf-5c13-45c2-915d-f90da94276f8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:20.114592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:20.138934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193607a6-4db3-4082-b764-c8ae9b216e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:20.139587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193607a6-4db3-4082-b764-c8ae9b216e8a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.139863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193607a6-4db3-4082-b764-c8ae9b216e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.140130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193607a6-4db3-4082-b764-c8ae9b216e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.158441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193607a6-4db3-4082-b764-c8ae9b216e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:20.159982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193607a6-4db3-4082-b764-c8ae9b216e8a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-193607a6-4db3-4082-b764-c8ae9b216e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:18:20.179532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:20.180391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:18:20.181169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:18:20.181169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:18:20.181169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:20.181169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 12/24] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:20.186851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c49c1-ce65-4ce2-82bd-eada0c27b4ab None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:20.254229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c89f-ce59-45f2-9785-d1f53adc0808 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.254502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c89f-ce59-45f2-9785-d1f53adc0808 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.254811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c89f-ce59-45f2-9785-d1f53adc0808 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.256103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 13/25] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:20.270738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8044-50c5-4ca8-a08c-c9e7824e6922 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.271048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8044-50c5-4ca8-a08c-c9e7824e6922 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.271286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8044-50c5-4ca8-a08c-c9e7824e6922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.302571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-806b8044-50c5-4ca8-a08c-c9e7824e6922 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:20.303761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-806b8044-50c5-4ca8-a08c-c9e7824e6922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:20.334317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:20.387365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c49c1-ce65-4ce2-82bd-eada0c27b4ab None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:20.439568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 14/26] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:20.441609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d41a5-ae1b-4fd2-a57e-191fe6a7c1c2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.441896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d41a5-ae1b-4fd2-a57e-191fe6a7c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.442172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d41a5-ae1b-4fd2-a57e-191fe6a7c1c2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.443470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 15/27] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:20.449827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab81981-6964-472b-bb34-83935f8dba68 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.450155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab81981-6964-472b-bb34-83935f8dba68 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.450792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab81981-6964-472b-bb34-83935f8dba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.465177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:20.465977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.466317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.466414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.467065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:20.467368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:20.468768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:20.509031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 13/28] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:20.510038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:20.594549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dab81981-6964-472b-bb34-83935f8dba68 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:20.595836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dab81981-6964-472b-bb34-83935f8dba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:20.652830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b17d-d6fa-4ae4-9f34-e1fc007c9ff8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:20.688308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb0f94-9891-4909-b6bf-c26f7896aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:20.688976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb0f94-9891-4909-b6bf-c26f7896aef6 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.689260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb0f94-9891-4909-b6bf-c26f7896aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.689666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb0f94-9891-4909-b6bf-c26f7896aef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.690267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb0f94-9891-4909-b6bf-c26f7896aef6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:20.691740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb0f94-9891-4909-b6bf-c26f7896aef6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:20.695770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:20.696920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:20.697980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab81981-6964-472b-bb34-83935f8dba68 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:20.743142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:20.823520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab81981-6964-472b-bb34-83935f8dba68 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:20.843552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 14/30] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Aug 8 02:18:20 2022] POST /identity/v3/roles => generated 219 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:20.845045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50676d-8505-4279-98b9-55f7f55b9085 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.845337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50676d-8505-4279-98b9-55f7f55b9085 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.854011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50676d-8505-4279-98b9-55f7f55b9085 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.855816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 15/31] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:20.856345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50676d-8505-4279-98b9-55f7f55b9085 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:20.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6c7b-7045-44e4-8811-08c4a550b48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:20.874878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6c7b-7045-44e4-8811-08c4a550b48f None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:20.875148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6c7b-7045-44e4-8811-08c4a550b48f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:20.875421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6c7b-7045-44e4-8811-08c4a550b48f None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:20.876315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6c7b-7045-44e4-8811-08c4a550b48f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:20.877847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6c7b-7045-44e4-8811-08c4a550b48f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:21.015779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50676d-8505-4279-98b9-55f7f55b9085 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:21.076459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:21.077836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.078409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.078901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.079801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:21.081664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:21.083011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 17/32] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:18:20 2022] POST /identity/v3/projects => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:21.084490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eaeaa-3141-4702-bdc7-70b05e095d06 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.084776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eaeaa-3141-4702-bdc7-70b05e095d06 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.085052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eaeaa-3141-4702-bdc7-70b05e095d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.103372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 16/33] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Aug 8 02:18:20 2022] POST /identity/v3/roles => generated 225 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:21.124132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2c4eaeaa-3141-4702-bdc7-70b05e095d06 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:21.125778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2c4eaeaa-3141-4702-bdc7-70b05e095d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:21.227968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 18/34] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:21.262888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:21.270110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ef4dd-b581-4758-89b9-75b2eb5b66c3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.270660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ef4dd-b581-4758-89b9-75b2eb5b66c3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.271126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ef4dd-b581-4758-89b9-75b2eb5b66c3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.272660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 19/35] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:21.278545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ab46-9702-4b0d-888c-418105129da7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.279208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ab46-9702-4b0d-888c-418105129da7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.279667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ab46-9702-4b0d-888c-418105129da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.310692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8221ab46-9702-4b0d-888c-418105129da7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:21.312214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8221ab46-9702-4b0d-888c-418105129da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:21.315678 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:21.341562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:21.399516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6bd55-9997-4ca5-861b-416bd6ff7fa6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:21.404954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 20/36] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:21.429025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ab46-9702-4b0d-888c-418105129da7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:21.439060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:21.439719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.439999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.440274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.454737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:21.460527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:21.461430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:21.462185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:21.465291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 17/37] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:21.474297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:21.560665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ab46-9702-4b0d-888c-418105129da7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:21.586231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29589a-3115-41ea-b5bb-1a4b757060bd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:21.599876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b42f-dcb4-4a5f-854f-575a39b2a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:21.601132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b42f-dcb4-4a5f-854f-575a39b2a6a3 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.602144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:21.603348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b42f-dcb4-4a5f-854f-575a39b2a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.603979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b42f-dcb4-4a5f-854f-575a39b2a6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.604881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702b42f-dcb4-4a5f-854f-575a39b2a6a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:21.606480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702b42f-dcb4-4a5f-854f-575a39b2a6a3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:21.626302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:21.626878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.627431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.627709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.628224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:21.628385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:21.628695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:21.630190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:21.640411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 18/38] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:21.641849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 21/39] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Aug 8 02:18:21 2022] POST /identity/v3/roles => generated 223 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:18:21.646209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:21.763902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025742-792e-40c2-a604-a8e1c535fd21 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:21.803603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:21.804238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.804546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.804819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] PATH_INFO: `/v3/users/55725fd30c284e01b807aa482bab0655` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.805971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] RBAC: Authorizing `identity:get_user(user_id=55725fd30c284e01b807aa482bab0655)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:21.807429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:21.809506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 19/40] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:21 2022] GET /identity/v3/users/55725fd30c284e01b807aa482bab0655 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:21.811731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61d19-e490-4540-aa00-d5d53273cd6b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.811731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61d19-e490-4540-aa00-d5d53273cd6b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.811731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61d19-e490-4540-aa00-d5d53273cd6b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.813260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 22/41] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:21.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:21.818341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d78f-3583-45de-88f1-8eabb84aedd7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.818633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d78f-3583-45de-88f1-8eabb84aedd7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.819843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d78f-3583-45de-88f1-8eabb84aedd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.840445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ede9d78f-3583-45de-88f1-8eabb84aedd7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:21.841919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ede9d78f-3583-45de-88f1-8eabb84aedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:21.865445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:21.908099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 23/42] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:21.918572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da3ae-a7c9-4ba6-af49-6736b5ebb96a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:21.930362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d78f-3583-45de-88f1-8eabb84aedd7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:21.953892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:21.954534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.954822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.955123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.956345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:21.957844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:21.959439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 20/43] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:21.965257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:22.028456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d78f-3583-45de-88f1-8eabb84aedd7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:22.056887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:22.063334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:22.063914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.064195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.064467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.065635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:22.066011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8807e-4cd1-43ba-885c-29261065e4ac None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:22.067098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:22.068689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 24/44] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:22.074287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:22.079575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:22.100215 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a418b05-f852-4581-ba4b-821a602cd582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:22.100902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a418b05-f852-4581-ba4b-821a602cd582 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.101163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a418b05-f852-4581-ba4b-821a602cd582 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.101470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a418b05-f852-4581-ba4b-821a602cd582 None admin] PATH_INFO: `/v3/domains/default/users/55725fd30c284e01b807aa482bab0655/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.103375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a418b05-f852-4581-ba4b-821a602cd582 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=55725fd30c284e01b807aa482bab0655, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:22.104849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a418b05-f852-4581-ba4b-821a602cd582 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:22.121001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 21/45] 10.222.0.25 () {58 vars in 1361 bytes} [Mon Aug 8 02:18:21 2022] PUT /identity/v3/domains/default/users/55725fd30c284e01b807aa482bab0655/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:22.187133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feabcec-09da-4178-a127-d82e8f005bec None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:22.224542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c103e-2176-4864-8596-4625c2651eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:22.225173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c103e-2176-4864-8596-4625c2651eb6 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.225496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c103e-2176-4864-8596-4625c2651eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.225780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c103e-2176-4864-8596-4625c2651eb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.226431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c103e-2176-4864-8596-4625c2651eb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:22.227940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c103e-2176-4864-8596-4625c2651eb6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:22.259462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:18:22 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:18:24.244625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9e1f-3d3b-4de8-b5c1-e3f1ebf96bd5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.245554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9e1f-3d3b-4de8-b5c1-e3f1ebf96bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.245554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9e1f-3d3b-4de8-b5c1-e3f1ebf96bd5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.246679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:24.252314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4118a8-b267-43c9-a461-192efd1c5efd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.252717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4118a8-b267-43c9-a461-192efd1c5efd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.252883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4118a8-b267-43c9-a461-192efd1c5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.271795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4e4118a8-b267-43c9-a461-192efd1c5efd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:24.273005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e4118a8-b267-43c9-a461-192efd1c5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.295959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f513cf-e6ad-40ec-b8db-cf49a6915b4c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.296224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f513cf-e6ad-40ec-b8db-cf49a6915b4c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.296523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f513cf-e6ad-40ec-b8db-cf49a6915b4c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.297928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 23/48] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:24.302891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768f22-e7e3-44eb-8f86-afbb125c2b5f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.303166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768f22-e7e3-44eb-8f86-afbb125c2b5f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.303451 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768f22-e7e3-44eb-8f86-afbb125c2b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.323488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-85768f22-e7e3-44eb-8f86-afbb125c2b5f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:24.324875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.325096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-85768f22-e7e3-44eb-8f86-afbb125c2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.347474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 26/49] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:24.370380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4118a8-b267-43c9-a461-192efd1c5efd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.393142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 24/50] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:24.426301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85768f22-e7e3-44eb-8f86-afbb125c2b5f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.473386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4118a8-b267-43c9-a461-192efd1c5efd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.506259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.506827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.507105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.507376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.518708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:24.524841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:24.525982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:24.526896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 27/51] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:24.532331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.536785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85768f22-e7e3-44eb-8f86-afbb125c2b5f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.538390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.572708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.573349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.573660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.573936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.575146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:24.576115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.577001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:24.578584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 25/52] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:24.584461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.633655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62bd1-824f-445b-944a-50bf2b0aac76 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.665685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.666302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.666579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.666852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.667520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:24.667819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:24.669240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:24.680866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 28/53] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:24.683396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe66b-b979-4d06-ba35-69ca837be27f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.686527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.717531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.718184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.718465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.718737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.719384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:24.720901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:24.752710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 26/54] 10.222.0.25 () {60 vars in 1140 bytes} [Mon Aug 8 02:18:24 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:18:24.807852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7010ab8-5c59-418f-84a4-f3d04e75ed04 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.809637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.846152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.846812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.848144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.848420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] PATH_INFO: `/v3/users/55725fd30c284e01b807aa482bab0655` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.849988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] RBAC: Authorizing `identity:get_user(user_id=55725fd30c284e01b807aa482bab0655)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:24.851518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:24.853190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 29/55] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:24 2022] GET /identity/v3/users/55725fd30c284e01b807aa482bab0655 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:24.859313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.885905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.964634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f3f3d-8812-4d5c-905b-a2d15b434514 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.997143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f6adf-ecf7-404e-b41a-c82df249d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.997809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6adf-ecf7-404e-b41a-c82df249d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.998089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6adf-ecf7-404e-b41a-c82df249d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.998361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6adf-ecf7-404e-b41a-c82df249d3e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.999457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f6adf-ecf7-404e-b41a-c82df249d3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:25.000917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f6adf-ecf7-404e-b41a-c82df249d3e4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:25.002531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 27/56] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:25.008783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:25.114690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ec68-a085-438d-adde-96b90817dbcb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:25.149508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095bb14-19da-4dd2-a290-5afc39481475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:25.150116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bb14-19da-4dd2-a290-5afc39481475 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:25.150394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bb14-19da-4dd2-a290-5afc39481475 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:25.150663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bb14-19da-4dd2-a290-5afc39481475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:25.151375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095bb14-19da-4dd2-a290-5afc39481475 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.domain.id=default, user.id=55725fd30c284e01b807aa482bab0655) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:25.151682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095bb14-19da-4dd2-a290-5afc39481475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:25.153412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095bb14-19da-4dd2-a290-5afc39481475 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:25.162677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 30/57] 10.222.0.25 () {56 vars in 1322 bytes} [Mon Aug 8 02:18:25 2022] GET /identity/v3/role_assignments?user.id=55725fd30c284e01b807aa482bab0655&scope.domain.id=default&role.id=1470302d39e340299072b424021b764b => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:26.746646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d9e0-9ec8-4bfd-92df-d2591c9e1375 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:26.747768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d9e0-9ec8-4bfd-92df-d2591c9e1375 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:26.747768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d9e0-9ec8-4bfd-92df-d2591c9e1375 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:26.750010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 28/58] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:26.758789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba232d-4796-4776-885a-c8261924cef3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:26.759481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba232d-4796-4776-885a-c8261924cef3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:26.759748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba232d-4796-4776-885a-c8261924cef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:26.782711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5bba232d-4796-4776-885a-c8261924cef3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:26.783917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5bba232d-4796-4776-885a-c8261924cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:26.815156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:26.859344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:26.887993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590d9e0-9ec8-4bfd-92df-d2591c9e1375 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:26.988905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:26.999814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590d9e0-9ec8-4bfd-92df-d2591c9e1375 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:27.034659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2452-ae76-4896-9848-7a35f80bc4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:27.035273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2452-ae76-4896-9848-7a35f80bc4fd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:27.035552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2452-ae76-4896-9848-7a35f80bc4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:27.035827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2452-ae76-4896-9848-7a35f80bc4fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:27.036974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2452-ae76-4896-9848-7a35f80bc4fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:27.038449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2452-ae76-4896-9848-7a35f80bc4fd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:27.040008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 29/60] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:27.047563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba232d-4796-4776-885a-c8261924cef3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:27.158568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba232d-4796-4776-885a-c8261924cef3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:27.193285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acb3f5-68cc-4b21-88b2-8ace0920be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:27.193915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acb3f5-68cc-4b21-88b2-8ace0920be75 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:27.194163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acb3f5-68cc-4b21-88b2-8ace0920be75 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:27.194461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acb3f5-68cc-4b21-88b2-8ace0920be75 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:27.195108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acb3f5-68cc-4b21-88b2-8ace0920be75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:27.196551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acb3f5-68cc-4b21-88b2-8ace0920be75 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:27.228450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 32/61] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:18:27 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:30.432969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445d23-a328-4648-9869-ec3ef02497d0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.433840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445d23-a328-4648-9869-ec3ef02497d0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.434314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445d23-a328-4648-9869-ec3ef02497d0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.436673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 30/62] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:30.442399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af406c6-6172-4398-a2c7-048dae2c3a12 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.443159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af406c6-6172-4398-a2c7-048dae2c3a12 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.443581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af406c6-6172-4398-a2c7-048dae2c3a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.472211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9af406c6-6172-4398-a2c7-048dae2c3a12 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:30.473693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9af406c6-6172-4398-a2c7-048dae2c3a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:30.496783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:30.542990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61439062-9836-4355-875c-db6b1d990070 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.543273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61439062-9836-4355-875c-db6b1d990070 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.543649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61439062-9836-4355-875c-db6b1d990070 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.545009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:30.550172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a016534-aa7a-470d-9eee-9457e3f625b0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.550454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a016534-aa7a-470d-9eee-9457e3f625b0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.550730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a016534-aa7a-470d-9eee-9457e3f625b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.568858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4a016534-aa7a-470d-9eee-9457e3f625b0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:30.570181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4a016534-aa7a-470d-9eee-9457e3f625b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:30.574651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:30.589299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69715dc6-d3a0-4120-a775-ada652778343 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.589614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69715dc6-d3a0-4120-a775-ada652778343 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.589898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69715dc6-d3a0-4120-a775-ada652778343 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.591807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 34/65] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:30.604591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69715dc6-d3a0-4120-a775-ada652778343 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:30.652695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:30.654625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aa8b1-481e-4bcf-a3ac-0c06f45b0674 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.655173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aa8b1-481e-4bcf-a3ac-0c06f45b0674 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.655633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aa8b1-481e-4bcf-a3ac-0c06f45b0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.674034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c63aa8b1-481e-4bcf-a3ac-0c06f45b0674 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:30.675493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c63aa8b1-481e-4bcf-a3ac-0c06f45b0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:30.746083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 33/67] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:30.747393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63aa8b1-481e-4bcf-a3ac-0c06f45b0674 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:30.754108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69715dc6-d3a0-4120-a775-ada652778343 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:30.781067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:30.800244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:30.801289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.801723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.802154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.813337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:30.818335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:30.819403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:30.820169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:30.822373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 35/68] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:30.823325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:30.836796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:30.879668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63aa8b1-481e-4bcf-a3ac-0c06f45b0674 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:30.918005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:30.918584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.919568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.919923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.931277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:30.936489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:30.937304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:30.938090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:18:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:30.938691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:30.941883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d4b89-e51a-4b0b-a9b2-bc5671a21434 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:30.976165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db049f-7085-4715-8d53-ad84f4408a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:30.976879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db049f-7085-4715-8d53-ad84f4408a08 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.977171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db049f-7085-4715-8d53-ad84f4408a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.977472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db049f-7085-4715-8d53-ad84f4408a08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.987589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db049f-7085-4715-8d53-ad84f4408a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-90db049f-7085-4715-8d53-ad84f4408a08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:30.992432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:30.993227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:30.994122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:30.995039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde08d-4926-4c4a-9adb-3cfc4b45251e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.995323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde08d-4926-4c4a-9adb-3cfc4b45251e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.995598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde08d-4926-4c4a-9adb-3cfc4b45251e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.000928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 37/71] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:31.000928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bde08d-4926-4c4a-9adb-3cfc4b45251e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.026973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.049058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec21d4-77fd-4919-af05-300c7905398e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.070657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.083222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ae7e0-5c5b-4a2c-8c5d-1e1d0b081b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.083917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae7e0-5c5b-4a2c-8c5d-1e1d0b081b17 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.084207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae7e0-5c5b-4a2c-8c5d-1e1d0b081b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.084480 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae7e0-5c5b-4a2c-8c5d-1e1d0b081b17 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.085153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ae7e0-5c5b-4a2c-8c5d-1e1d0b081b17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:31.085491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ae7e0-5c5b-4a2c-8c5d-1e1d0b081b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.086906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ae7e0-5c5b-4a2c-8c5d-1e1d0b081b17 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.094934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 35/72] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:31.096086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570a30-971c-429d-90eb-86fbdf6fa781 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.096441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570a30-971c-429d-90eb-86fbdf6fa781 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.096723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570a30-971c-429d-90eb-86fbdf6fa781 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.097952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 36/73] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:31.102366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570a30-971c-429d-90eb-86fbdf6fa781 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.103588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bde08d-4926-4c4a-9adb-3cfc4b45251e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.139581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d4fc-ccc4-4070-a354-251584c82fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.140195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d4fc-ccc4-4070-a354-251584c82fab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.140478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d4fc-ccc4-4070-a354-251584c82fab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.140749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d4fc-ccc4-4070-a354-251584c82fab None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.141449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243d4fc-ccc4-4070-a354-251584c82fab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:31.141758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243d4fc-ccc4-4070-a354-251584c82fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.143153 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243d4fc-ccc4-4070-a354-251584c82fab None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.151035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 38/74] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:18:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:31.151035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae15df-cb9d-4937-b694-d914358dd603 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.151035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae15df-cb9d-4937-b694-d914358dd603 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.151035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae15df-cb9d-4937-b694-d914358dd603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.171269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-25ae15df-cb9d-4937-b694-d914358dd603 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:31.172474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-25ae15df-cb9d-4937-b694-d914358dd603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:31.207668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570a30-971c-429d-90eb-86fbdf6fa781 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.238965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 39/75] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:31.239633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae15df-cb9d-4937-b694-d914358dd603 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.252537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa322cd-bff6-428f-9215-a88ca420e33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.253123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa322cd-bff6-428f-9215-a88ca420e33c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.253440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa322cd-bff6-428f-9215-a88ca420e33c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.253773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa322cd-bff6-428f-9215-a88ca420e33c None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.254435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa322cd-bff6-428f-9215-a88ca420e33c None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:31.254757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa322cd-bff6-428f-9215-a88ca420e33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.256150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa322cd-bff6-428f-9215-a88ca420e33c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.264702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 37/76] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:31.265918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571314e-0cd3-41ca-aee5-f58acf2d4f74 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.266203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571314e-0cd3-41ca-aee5-f58acf2d4f74 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.266483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571314e-0cd3-41ca-aee5-f58acf2d4f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.272423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.285236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a571314e-0cd3-41ca-aee5-f58acf2d4f74 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:31.286439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a571314e-0cd3-41ca-aee5-f58acf2d4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:31.301604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.341617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae15df-cb9d-4937-b694-d914358dd603 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.353756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 38/77] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:31.354591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571314e-0cd3-41ca-aee5-f58acf2d4f74 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.375064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.375708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.375987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.376257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] PATH_INFO: `/v3/users/55725fd30c284e01b807aa482bab0655` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.377401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] RBAC: Authorizing `identity:get_user(user_id=55725fd30c284e01b807aa482bab0655)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.378859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.380491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 40/78] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/users/55725fd30c284e01b807aa482bab0655 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:31.381392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.475105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571314e-0cd3-41ca-aee5-f58acf2d4f74 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.482018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab123b-5a60-4e89-8707-736addeaed3c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.505341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.511603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.511741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.512392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.512705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.512974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.518296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.518939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.519224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.519504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.520722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.522236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.523834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 41/79] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:31.529001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.531142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.532615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.534321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 39/80] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:31.536501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.626241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88e96b-cc36-4905-a4d4-4cb52d2d38de None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.636674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884823a6-f8c1-41f8-957a-9c2221f3e4a9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.661205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.661961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.662243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.662515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.663648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.665121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.666746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 42/81] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:31.671926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.672011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.672011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.672011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.672011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.680852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:31.685845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:31.686658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:31.687381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 40/82] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:31.687985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.737007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.739601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.776238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b02c38-27b4-4c5b-8cc5-0fe2bef1065f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.786148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a134-f452-498c-b5e9-5467f356fd21 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.811832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.812444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.812722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.812993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.819680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.820319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.820614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.820887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.821569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.823051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.851327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 41/83] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:18:31 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:31.854335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:31.888364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.889997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.968409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.973479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05dd06-940a-4e90-8282-1500952bf378 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:31.982166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:32.011254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 43/84] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:32.012152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.016727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.017398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.017688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.017967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.102838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.104266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.137910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ed54-bd6a-4e62-9676-01346abe86d2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.178277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.178899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.179184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.179464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.215481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:32.225523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:32.226841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.241768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:32.265876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.268192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.354241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b007c-12c9-4167-bd78-0f3d97f4d9ce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.378679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 44/86] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:32.379720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.391206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.391838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.392129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.392508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.393198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:32.393542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.395105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.404573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 43/87] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:32.410323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.448405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:32.481275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:32.485839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656d18-3019-4baa-9098-55192d891a8a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.518797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e1524-403a-4e7e-a293-04c52b6dc402 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.523025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.523688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.523969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.524246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.525417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.526873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.528672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 45/88] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:32.529565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.561189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.561968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.562257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.562624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.563840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.565315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.567516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 44/89] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:32.568310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.655842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9f63b-7976-48bf-b763-0a16921b9dea None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.698250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.698903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.699252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.699535 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.701007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2e62-4383-47bb-bc06-fa5a276844bc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.701122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.702606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.705310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 46/90] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:32.706126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.708794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:32.743701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.744635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.745185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.745920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.747562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.749426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.752469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 45/91] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:32.753450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.758496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:32.833780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bb926-ab26-4d12-97b2-462206ca03f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.875165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.875892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.876188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.876466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.877438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=55725fd30c284e01b807aa482bab0655) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:32.877693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.879756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.881202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad28cb-260b-44b1-a4bd-596ffe3f8eb3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:32.886284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 47/92] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/role_assignments?user.id=55725fd30c284e01b807aa482bab0655&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:32.887111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.950206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:32.951005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:32.951453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:32.951737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:32.952493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] RBAC: Adding query filter params (role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=dff8474fbe1e4c859a1f366802002642) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:32.952812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:32.954318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:32.973750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 46/93] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/role_assignments?user.id=dff8474fbe1e4c859a1f366802002642&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=d138e21392054605846b1a7ee19e3814 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:32.973750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:32.997914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:33.058754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc940b5-9ba2-4c4a-ae42-2f7f18c53855 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:33.099727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:33.112877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:33.118261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:33.118814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:33.119265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:33.120348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=dff8474fbe1e4c859a1f366802002642) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:33.120801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:33.122903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:33.129996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 48/94] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/role_assignments?user.id=dff8474fbe1e4c859a1f366802002642&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:33.169911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5035a-629f-420f-bf74-b3468603c29b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:33.227075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:33.227745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:33.228064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:33.228376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:33.315797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:33.317354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:33.390050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:33.427152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 47/95] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:33.432856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:33.577617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18f4e2-d4b2-4e2f-9ac7-6996a4b57189 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:33.609834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:33.613624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a3606-d149-4acd-85d1-74b8d128fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:33.614432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3606-d149-4acd-85d1-74b8d128fd09 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:33.614957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3606-d149-4acd-85d1-74b8d128fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:33.615598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3606-d149-4acd-85d1-74b8d128fd09 None admin] PATH_INFO: `/v3/projects/b8eb856623844df8831c4532b9f18009` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:33.616526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a3606-d149-4acd-85d1-74b8d128fd09 None admin] RBAC: Authorizing `identity:get_project(project_id=b8eb856623844df8831c4532b9f18009)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:33.618093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a3606-d149-4acd-85d1-74b8d128fd09 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:33.621120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 49/96] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:33 2022] GET /identity/v3/projects/b8eb856623844df8831c4532b9f18009 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:33.631423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:33.755893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3685-5afa-46fa-917e-3b0b8808895c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:33.791131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67473d5-da6c-4743-ad03-a03d5f498bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:33.791753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67473d5-da6c-4743-ad03-a03d5f498bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:33.792039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67473d5-da6c-4743-ad03-a03d5f498bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:33.792320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67473d5-da6c-4743-ad03-a03d5f498bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:33.793066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67473d5-da6c-4743-ad03-a03d5f498bf0 None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=b8eb856623844df8831c4532b9f18009, user.id=dff8474fbe1e4c859a1f366802002642) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:33.793461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67473d5-da6c-4743-ad03-a03d5f498bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:33.795106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67473d5-da6c-4743-ad03-a03d5f498bf0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:33.800885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 48/97] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:33 2022] GET /identity/v3/role_assignments?user.id=dff8474fbe1e4c859a1f366802002642&scope.project.id=b8eb856623844df8831c4532b9f18009&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:34.479388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d54a-5614-4a3a-927f-a4a1c90662b5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:34.479791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d54a-5614-4a3a-927f-a4a1c90662b5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:34.479963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d54a-5614-4a3a-927f-a4a1c90662b5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:34.481687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 50/98] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:34.486487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938082b-4f86-4c1d-9319-86a23e63e8a0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:34.486780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938082b-4f86-4c1d-9319-86a23e63e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:34.487058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938082b-4f86-4c1d-9319-86a23e63e8a0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:34.488510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 49/99] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:34.489692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e405cd-64e4-493e-ba4a-70fe9c78f6bd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:34.489974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e405cd-64e4-493e-ba4a-70fe9c78f6bd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:34.490248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e405cd-64e4-493e-ba4a-70fe9c78f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:34.498348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134f78-a3a3-46f1-9c75-3ae3a570db14 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:34.498630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134f78-a3a3-46f1-9c75-3ae3a570db14 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:34.498905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134f78-a3a3-46f1-9c75-3ae3a570db14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:34.521900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e4e405cd-64e4-493e-ba4a-70fe9c78f6bd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:34.523127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e4e405cd-64e4-493e-ba4a-70fe9c78f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:34.526192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-70134f78-a3a3-46f1-9c75-3ae3a570db14 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:34.527353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-70134f78-a3a3-46f1-9c75-3ae3a570db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:34.584154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:34.600293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 51/100] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:34.644888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e405cd-64e4-493e-ba4a-70fe9c78f6bd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:34.673791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:34.710490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70134f78-a3a3-46f1-9c75-3ae3a570db14 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:34.781332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e405cd-64e4-493e-ba4a-70fe9c78f6bd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:34.809929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:34.816947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:34.817631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:34.817921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:34.818193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:34.829933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:34.834825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:34.835640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:34.836358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 52/102] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:34.846295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:34.885886 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70134f78-a3a3-46f1-9c75-3ae3a570db14 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:34.958919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:34.959569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:34.959876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:34.960218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:34.966052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:34.967519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:34.969436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 51/103] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:34.975540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:34.984102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fccb77-7722-4cae-adb3-f785d78d3899 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:35.021234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:35.022320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:35.022946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:35.023229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:35.023505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:35.024241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:35.024587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:35.025983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:35.036660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 53/104] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:35.042482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:35.094874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246916e-e258-45ad-b2f1-65e8eca738e3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:35.097541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:35.129419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47177676-95e3-4f31-a888-881413d2404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:35.130029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177676-95e3-4f31-a888-881413d2404a None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:35.130306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177676-95e3-4f31-a888-881413d2404a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:35.130582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177676-95e3-4f31-a888-881413d2404a None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:35.131232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47177676-95e3-4f31-a888-881413d2404a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:35.132685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47177676-95e3-4f31-a888-881413d2404a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:35.154506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8832-fb1d-4213-ab12-2d9f7a8d9725 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:35.187230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 52/105] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:18:34 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:18:35.204979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:35.205726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:35.206134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:35.206411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] PATH_INFO: `/v3/users/c4829797ea1e4b48acf7950bfc5021a1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:35.233832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] RBAC: Authorizing `identity:get_user(user_id=c4829797ea1e4b48acf7950bfc5021a1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:35.235430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:35.237782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 54/106] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:35 2022] GET /identity/v3/users/c4829797ea1e4b48acf7950bfc5021a1 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:35.243919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47177676-95e3-4f31-a888-881413d2404a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:35.371929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:35.396078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47177676-95e3-4f31-a888-881413d2404a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:35.451893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:35.452919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:35.453422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:35.453892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:35.554655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:35.556507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:35.685888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:35.712413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 53/107] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:35.718314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:35.841820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169e58e-394a-424e-a065-73340c559c0a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:35.853623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:35.884992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e5ef5-a1b1-4baa-9adb-1fe23151d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:35.885601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e5ef5-a1b1-4baa-9adb-1fe23151d70e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:35.885885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e5ef5-a1b1-4baa-9adb-1fe23151d70e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:35.886162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e5ef5-a1b1-4baa-9adb-1fe23151d70e None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:35.887378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e5ef5-a1b1-4baa-9adb-1fe23151d70e None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:35.888938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e5ef5-a1b1-4baa-9adb-1fe23151d70e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:35.892081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 55/108] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:35 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:35.897225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:35.913183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603e83-eb78-4cf9-9cf7-625a054f000e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:35.913490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603e83-eb78-4cf9-9cf7-625a054f000e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:35.913773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603e83-eb78-4cf9-9cf7-625a054f000e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:35.917452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 56/109] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:35.921175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c111-8ee2-40ae-8ee4-0e0e3ce940d5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:35.921526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c111-8ee2-40ae-8ee4-0e0e3ce940d5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:35.921807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c111-8ee2-40ae-8ee4-0e0e3ce940d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:35.940718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1f36c111-8ee2-40ae-8ee4-0e0e3ce940d5 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:35.941960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1f36c111-8ee2-40ae-8ee4-0e0e3ce940d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:36.025704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073dd8-af01-4c47-9530-9d178266b245 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:36.052067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 57/110] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:36.060641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806c1e4-b83d-4cdc-9d78-407a120ed662 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.060928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806c1e4-b83d-4cdc-9d78-407a120ed662 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.061207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806c1e4-b83d-4cdc-9d78-407a120ed662 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.064802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 58/111] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:36.069078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d64fae-757a-4e1c-a443-6f06f3cdd7e0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.069387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d64fae-757a-4e1c-a443-6f06f3cdd7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.069685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d64fae-757a-4e1c-a443-6f06f3cdd7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.111779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-95d64fae-757a-4e1c-a443-6f06f3cdd7e0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:36.112999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-95d64fae-757a-4e1c-a443-6f06f3cdd7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:36.118110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:36.118792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.119083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.119358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.120095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] RBAC: Adding query filter params (role.id=dbab5115a54f48bca375041930970192, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=c4829797ea1e4b48acf7950bfc5021a1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:36.120582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:36.122133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:36.140562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 54/112] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:35 2022] GET /identity/v3/role_assignments?user.id=c4829797ea1e4b48acf7950bfc5021a1&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=dbab5115a54f48bca375041930970192 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:36.167734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:36.261765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:36.270761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 59/113] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:36.307648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d64fae-757a-4e1c-a443-6f06f3cdd7e0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:36.380934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa733-4141-4cf8-a61c-1cb658df5ead None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:36.385735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:36.456791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:36.457472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.457759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.458035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.473531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:36.487059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:36.487951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:36.488679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 55/114] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:18:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:36.498554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:36.507646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d64fae-757a-4e1c-a443-6f06f3cdd7e0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:36.567883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:36.568544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.568823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.569097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.593263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:36.602159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:36.603027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:36.603760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 60/115] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:18:36.609971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:36.676924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56ee4-bb0e-447b-99e3-ebcd13ae23d4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:36.686786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:36.722227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231992a7-e7e7-499f-813e-d970223e7e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:36.723321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231992a7-e7e7-499f-813e-d970223e7e7d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.724187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231992a7-e7e7-499f-813e-d970223e7e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.724669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231992a7-e7e7-499f-813e-d970223e7e7d None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.725804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231992a7-e7e7-499f-813e-d970223e7e7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:36.726302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231992a7-e7e7-499f-813e-d970223e7e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:36.727898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231992a7-e7e7-499f-813e-d970223e7e7d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:36.737649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 56/116] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:18:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:36.743806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c24c-174d-4d84-a04b-1a5897eee66e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.744835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c24c-174d-4d84-a04b-1a5897eee66e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.745312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c24c-174d-4d84-a04b-1a5897eee66e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.747180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 57/117] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:36.748448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c24c-174d-4d84-a04b-1a5897eee66e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:36.758977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:36.771438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d977631-1295-4498-b0f6-05e109492f62 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:36.849397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a49def-9137-4621-a460-030e32c88a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:36.851239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49def-9137-4621-a460-030e32c88a56 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.853526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49def-9137-4621-a460-030e32c88a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.853806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49def-9137-4621-a460-030e32c88a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.854492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a49def-9137-4621-a460-030e32c88a56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:36.854863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a49def-9137-4621-a460-030e32c88a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:36.858252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a49def-9137-4621-a460-030e32c88a56 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:36.867559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 61/118] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:36.869117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e396ff-ac31-4827-9806-d80844e5de9f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.869572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e396ff-ac31-4827-9806-d80844e5de9f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.869985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e396ff-ac31-4827-9806-d80844e5de9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.888966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-26e396ff-ac31-4827-9806-d80844e5de9f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:36.889707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c24c-174d-4d84-a04b-1a5897eee66e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:36.890662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-26e396ff-ac31-4827-9806-d80844e5de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:36.940175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b7fee-87da-49b3-bd82-508f126a7ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:36.940965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7fee-87da-49b3-bd82-508f126a7ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.941246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7fee-87da-49b3-bd82-508f126a7ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.941544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7fee-87da-49b3-bd82-508f126a7ba5 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.942852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b7fee-87da-49b3-bd82-508f126a7ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:36.944980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b7fee-87da-49b3-bd82-508f126a7ba5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:36.947381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 58/119] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:36 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:36.947813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2d41-c281-441d-96e8-534c436d8dd0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:36.948096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2d41-c281-441d-96e8-534c436d8dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:36.948369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2d41-c281-441d-96e8-534c436d8dd0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:36.949868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 59/120] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:36.953438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec2d41-c281-441d-96e8-534c436d8dd0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:36.974225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 62/121] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:36.975249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e396ff-ac31-4827-9806-d80844e5de9f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:36.999391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:37.077773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:37.081745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec2d41-c281-441d-96e8-534c436d8dd0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.081907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e396ff-ac31-4827-9806-d80844e5de9f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.118216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b81c16-06fb-4365-b6c0-6aa7db5d7bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.119023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81c16-06fb-4365-b6c0-6aa7db5d7bca None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.119398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81c16-06fb-4365-b6c0-6aa7db5d7bca None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.119792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81c16-06fb-4365-b6c0-6aa7db5d7bca None admin] PATH_INFO: `/v3/users/55725fd30c284e01b807aa482bab0655` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.121072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b81c16-06fb-4365-b6c0-6aa7db5d7bca None admin] RBAC: Authorizing `identity:get_user(user_id=55725fd30c284e01b807aa482bab0655)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.122755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b81c16-06fb-4365-b6c0-6aa7db5d7bca None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.124048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.124697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.124976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.125249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.126409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.127835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.129157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 60/122] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:36 2022] GET /identity/v3/users/55725fd30c284e01b807aa482bab0655 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:37.129558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 63/123] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:36 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:37.130325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.130552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d968-a02a-4aff-b294-b24ed65168f4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.130841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d968-a02a-4aff-b294-b24ed65168f4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.131698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d968-a02a-4aff-b294-b24ed65168f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.150954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-54f6d968-a02a-4aff-b294-b24ed65168f4 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:37.152154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-54f6d968-a02a-4aff-b294-b24ed65168f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:37.228213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 61/124] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:37.234425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d968-a02a-4aff-b294-b24ed65168f4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.272602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:37.273328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ecee-e72c-49ac-baba-1e413e16646c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.307640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.308691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.309110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.309585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.320464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:37.325973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:37.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 64/125] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:37.329823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.346653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d968-a02a-4aff-b294-b24ed65168f4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.381743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:37.383085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.383858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.384187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.384520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.385780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.387289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.389047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 62/126] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:37 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:37.389852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.439676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac3711-9186-43f4-af2e-f0ca12ffaee2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.474882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.475614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.475901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.476173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072/users/dff8474fbe1e4c859a1f366802002642/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.478485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] RBAC: Authorizing `identity:create_grant(project_id=14a696a642e44af38cba2ff089f73072, user_id=dff8474fbe1e4c859a1f366802002642, role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.479889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.495921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d367-8e2a-4893-b46a-466abfd1ff5a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.498068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:37.501105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 65/127] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:37 2022] PUT /identity/v3/projects/14a696a642e44af38cba2ff089f73072/users/dff8474fbe1e4c859a1f366802002642/roles/d138e21392054605846b1a7ee19e3814 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:37.502514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.539821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0651-7481-4236-8417-94387774637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.540457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0651-7481-4236-8417-94387774637d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.540742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0651-7481-4236-8417-94387774637d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.541054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0651-7481-4236-8417-94387774637d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.553311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb0651-7481-4236-8417-94387774637d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6deb0651-7481-4236-8417-94387774637d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:37.559489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:37.560430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:37.561198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:37.566066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 63/128] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:37.566066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0651-7481-4236-8417-94387774637d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.667413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:37.694844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0651-7481-4236-8417-94387774637d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.727043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a459-7228-4054-b1c1-2706b65f2fca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.732810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.733765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.734320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.734798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072/users/55725fd30c284e01b807aa482bab0655/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.737031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=14a696a642e44af38cba2ff089f73072, user_id=55725fd30c284e01b807aa482bab0655, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.738714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.760105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 64/129] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:37 2022] PUT /identity/v3/projects/14a696a642e44af38cba2ff089f73072/users/55725fd30c284e01b807aa482bab0655/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:37.762139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.767063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.767614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.767832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.768168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.768872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:37.769177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.770731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.781425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 66/130] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:37.787525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.798122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:37.914089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b50a43-2fb6-44fd-8c11-d40b839294e5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.934669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285022-d67f-4c05-8fa7-a34dd5bca7ae None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:37.952255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.952885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.953168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.953490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.954492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:37.954812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.956791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.969021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 65/131] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:37.974528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:37.987430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:37.988352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:37.988812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:37.989238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:37.992859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:37.994595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:37.997002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 67/132] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:37 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:38.004278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:38.018706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:38.137275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:38.156370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dd60-5598-481b-8275-1358b85640d8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:38.156972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c49cd9-5f29-4767-9027-0c5091a88271 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:38.196762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbab8a-7795-40cc-bb35-049f1dc82774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:38.197441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbab8a-7795-40cc-bb35-049f1dc82774 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.197728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbab8a-7795-40cc-bb35-049f1dc82774 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.198010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbab8a-7795-40cc-bb35-049f1dc82774 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.199168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbab8a-7795-40cc-bb35-049f1dc82774 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:38.201019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbab8a-7795-40cc-bb35-049f1dc82774 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:38.203028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 66/133] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:37 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:38.204287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae92d1-ba2c-42cb-b8bb-037bcdf88ac8 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.204573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae92d1-ba2c-42cb-b8bb-037bcdf88ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.204848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae92d1-ba2c-42cb-b8bb-037bcdf88ac8 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.206080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 67/134] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:38.210825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae92d1-ba2c-42cb-b8bb-037bcdf88ac8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:38.211685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b67a6-c476-4bdd-b11d-25197efb2e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:38.212570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b67a6-c476-4bdd-b11d-25197efb2e93 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.213038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b67a6-c476-4bdd-b11d-25197efb2e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.213658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b67a6-c476-4bdd-b11d-25197efb2e93 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.215046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b67a6-c476-4bdd-b11d-25197efb2e93 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:38.216819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b67a6-c476-4bdd-b11d-25197efb2e93 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:38.218778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 68/135] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:38 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:38.220119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca557-c6e8-41cb-aabe-89f0885659ee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.220704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca557-c6e8-41cb-aabe-89f0885659ee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.221165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca557-c6e8-41cb-aabe-89f0885659ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.257763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a52ca557-c6e8-41cb-aabe-89f0885659ee None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:38.258922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a52ca557-c6e8-41cb-aabe-89f0885659ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:38.369495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 69/136] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:38.375083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ca557-c6e8-41cb-aabe-89f0885659ee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:38.391095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:38.392139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae92d1-ba2c-42cb-b8bb-037bcdf88ac8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:38.505629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ca557-c6e8-41cb-aabe-89f0885659ee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:38.507343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:38.508057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.508282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.508558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] PATH_INFO: `/v3/projects/b8eb856623844df8831c4532b9f18009` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.509762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] RBAC: Authorizing `identity:get_project(project_id=b8eb856623844df8831c4532b9f18009)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:38.511242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:38.526078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 68/137] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:38 2022] GET /identity/v3/projects/b8eb856623844df8831c4532b9f18009 => generated 312 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:38.527009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:38.541839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:38.542528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.542862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.543138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072/users/dff8474fbe1e4c859a1f366802002642/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.545202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] RBAC: Authorizing `identity:create_grant(project_id=14a696a642e44af38cba2ff089f73072, user_id=dff8474fbe1e4c859a1f366802002642, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:38.546916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:38.565522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 70/138] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:38 2022] PUT /identity/v3/projects/14a696a642e44af38cba2ff089f73072/users/dff8474fbe1e4c859a1f366802002642/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:38.566435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:38.573962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:38.650856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:38.701409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac388-22fa-4aed-884e-5dafda4c11ee None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:38.738426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67acad7-f98b-4a54-b276-c7befe4f6e79 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:38.758205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c5166-6bdb-4c67-af16-1e197c42357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:38.758827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c5166-6bdb-4c67-af16-1e197c42357b None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.759110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c5166-6bdb-4c67-af16-1e197c42357b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.759390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c5166-6bdb-4c67-af16-1e197c42357b None admin] PATH_INFO: `/v3/projects/b8eb856623844df8831c4532b9f18009/users/dff8474fbe1e4c859a1f366802002642/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.762315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c5166-6bdb-4c67-af16-1e197c42357b None admin] RBAC: Authorizing `identity:create_grant(project_id=b8eb856623844df8831c4532b9f18009, user_id=dff8474fbe1e4c859a1f366802002642, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:38.763888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c5166-6bdb-4c67-af16-1e197c42357b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:38.784173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:38.784832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.785169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.785606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.787421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:38.789019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:38.791024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 69/139] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:38.798073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:38.804762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 71/140] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:38 2022] PUT /identity/v3/projects/b8eb856623844df8831c4532b9f18009/users/dff8474fbe1e4c859a1f366802002642/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:38.904717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:38.919110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e320a-6331-4245-ae87-129aad713071 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:38.957979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de970d39-52eb-4b38-b3cc-63f823e1caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:38.958670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de970d39-52eb-4b38-b3cc-63f823e1caa7 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:38.959004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de970d39-52eb-4b38-b3cc-63f823e1caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:38.959286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de970d39-52eb-4b38-b3cc-63f823e1caa7 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:38.959959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de970d39-52eb-4b38-b3cc-63f823e1caa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:38.963433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de970d39-52eb-4b38-b3cc-63f823e1caa7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:39.002742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 70/141] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:18:38 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:39.188042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84355c57-17d5-44a9-916e-770d2c9c4d8f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:39.188401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84355c57-17d5-44a9-916e-770d2c9c4d8f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:39.188603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84355c57-17d5-44a9-916e-770d2c9c4d8f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:39.190321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 72/142] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:39.195703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eafad-c696-4032-832e-434538fa1536 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:39.195990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eafad-c696-4032-832e-434538fa1536 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:39.196271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eafad-c696-4032-832e-434538fa1536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:39.220442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5d7eafad-c696-4032-832e-434538fa1536 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:39.221675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5d7eafad-c696-4032-832e-434538fa1536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:39.314535 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 71/143] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:39.348210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84355c57-17d5-44a9-916e-770d2c9c4d8f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:39.481912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84355c57-17d5-44a9-916e-770d2c9c4d8f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:39.509029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:39.524338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:39.525512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:39.525805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:39.526133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:39.543817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:39.548606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:39.549452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:39.550189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 73/144] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:39.557250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eafad-c696-4032-832e-434538fa1536 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:39.646447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:39.672642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eafad-c696-4032-832e-434538fa1536 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:39.719417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:39.720045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:39.720407 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:39.720690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:39.721378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:39.721691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:39.723097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:39.731786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 72/145] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:39.737866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:39.860542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04ff7-fa26-4fab-8cba-b6815ba986f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:39.899333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33c65d-402a-4964-88a6-9c3f1457ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:39.899989 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c65d-402a-4964-88a6-9c3f1457ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:39.900271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c65d-402a-4964-88a6-9c3f1457ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:39.900549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c65d-402a-4964-88a6-9c3f1457ffd0 None admin] PATH_INFO: `/v3/users/c4829797ea1e4b48acf7950bfc5021a1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:39.903120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33c65d-402a-4964-88a6-9c3f1457ffd0 None admin] RBAC: Authorizing `identity:get_user(user_id=c4829797ea1e4b48acf7950bfc5021a1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:39.904665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33c65d-402a-4964-88a6-9c3f1457ffd0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:39.906491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 74/146] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:39 2022] GET /identity/v3/users/c4829797ea1e4b48acf7950bfc5021a1 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:39.912756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:39.993247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc577f-afd9-47c9-a5ff-502f5cc3b6c1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:39.993455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc577f-afd9-47c9-a5ff-502f5cc3b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:39.993727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc577f-afd9-47c9-a5ff-502f5cc3b6c1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:39.995084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 75/147] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:40.000615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cdd4e-9bb7-439f-afa5-1243ccc6173b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:40.000896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cdd4e-9bb7-439f-afa5-1243ccc6173b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:40.001176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cdd4e-9bb7-439f-afa5-1243ccc6173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:40.026043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d37cdd4e-9bb7-439f-afa5-1243ccc6173b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:40.027421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d37cdd4e-9bb7-439f-afa5-1243ccc6173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:40.045657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa72de-5507-47d0-90ec-8603279f3ba3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:40.086447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:40.087408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:40.087854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:40.088287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:40.089606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:40.091658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:40.093588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 73/148] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:39 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:40.094278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:40.101541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:40.108498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:40.127836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 76/149] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:40.174060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cdd4e-9bb7-439f-afa5-1243ccc6173b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:40.289822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dafe-735a-4c54-8756-05cd612dffa9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:40.365737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:40.367671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:40.373823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:40.374111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072/users/c4829797ea1e4b48acf7950bfc5021a1/roles/dbab5115a54f48bca375041930970192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:40.376303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] RBAC: Authorizing `identity:create_grant(project_id=14a696a642e44af38cba2ff089f73072, user_id=c4829797ea1e4b48acf7950bfc5021a1, role_id=dbab5115a54f48bca375041930970192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:40.377829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:40.385199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cdd4e-9bb7-439f-afa5-1243ccc6173b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:40.432091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 74/150] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:40 2022] PUT /identity/v3/projects/14a696a642e44af38cba2ff089f73072/users/c4829797ea1e4b48acf7950bfc5021a1/roles/dbab5115a54f48bca375041930970192 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:18:40.433603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:40.434663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:40.435225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:40.435664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:40.451841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:40.457172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:40.458071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:40.458803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:40.465828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 77/151] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:18:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:18:40.470547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:40.562281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:40.611119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033e77e-cdf3-4fd7-aca4-90df54171a28 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:40.674148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:40.674783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:40.675063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:40.675337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:40.676050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:40.676352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:40.677811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:40.690274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 75/152] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:18:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:40.696749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:40.759996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:40.822636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983a438-6fe5-4e3c-90ec-9f74cab77d43 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:40.863011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:40.864460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:40.864925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:40.865393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:40.866718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:40.868373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:40.870194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 78/153] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:40 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:40.878540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:41.030866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c40cf-b2f2-4bf1-94f7-33c5d0ff4c27 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:41.062061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:41.072080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:41.072751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.072978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.073257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.154463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:41.155975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:41.263985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 76/154] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:41.270319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:41.417173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6fe61-f7aa-42ea-96bc-dac96a8792c9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:41.430252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:41.467464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86480d-f5e6-4918-abe5-e59e12c63d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:41.468123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86480d-f5e6-4918-abe5-e59e12c63d05 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.468405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86480d-f5e6-4918-abe5-e59e12c63d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.468680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86480d-f5e6-4918-abe5-e59e12c63d05 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.469865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86480d-f5e6-4918-abe5-e59e12c63d05 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:41.471338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86480d-f5e6-4918-abe5-e59e12c63d05 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:41.473001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 79/155] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:41 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:41.479130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:41.509773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b8c2-241f-4e05-ac33-e006bb0d8bcb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.510074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b8c2-241f-4e05-ac33-e006bb0d8bcb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.510326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b8c2-241f-4e05-ac33-e006bb0d8bcb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.511685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 80/156] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:41.517573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2d266-cb7a-4fcd-ab50-809686e19469 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.517859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2d266-cb7a-4fcd-ab50-809686e19469 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.518135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2d266-cb7a-4fcd-ab50-809686e19469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.525613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:41.550066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-17b2d266-cb7a-4fcd-ab50-809686e19469 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:41.551289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-17b2d266-cb7a-4fcd-ab50-809686e19469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:41.681464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b86a-30d5-46e5-921f-e17d4bee04cf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:41.712016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 81/157] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:41.739520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311e0a1-27bb-47b9-bbda-06ccc130ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:41.740142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e0a1-27bb-47b9-bbda-06ccc130ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.740421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e0a1-27bb-47b9-bbda-06ccc130ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.740697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e0a1-27bb-47b9-bbda-06ccc130ddd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.741510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311e0a1-27bb-47b9-bbda-06ccc130ddd9 None admin] RBAC: Adding query filter params (role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=dff8474fbe1e4c859a1f366802002642) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:41.741828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311e0a1-27bb-47b9-bbda-06ccc130ddd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:41.743299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311e0a1-27bb-47b9-bbda-06ccc130ddd9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:41.750188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2d266-cb7a-4fcd-ab50-809686e19469 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:41.753378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 77/158] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:41 2022] GET /identity/v3/role_assignments?user.id=dff8474fbe1e4c859a1f366802002642&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=d138e21392054605846b1a7ee19e3814 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:41.906798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2d266-cb7a-4fcd-ab50-809686e19469 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:41.927601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:41.952303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509de1c-5dba-4b09-901a-578887501f9b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.952492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509de1c-5dba-4b09-901a-578887501f9b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.952766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509de1c-5dba-4b09-901a-578887501f9b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.955514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 78/159] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:41.955917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:41.956642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.956920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.957191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.959877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21fca-81a5-494f-82f5-055a4480dc12 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:41.960153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21fca-81a5-494f-82f5-055a4480dc12 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:41.960432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21fca-81a5-494f-82f5-055a4480dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:41.975474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:41.980480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:41.981483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:41.982458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:41.983049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 82/160] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:41.986360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fcd21fca-81a5-494f-82f5-055a4480dc12 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:41.988698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:41.989568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fcd21fca-81a5-494f-82f5-055a4480dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:42.099587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73664d38-0c11-4a42-b9ca-dc94aa770889 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:42.120184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 79/161] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:42.138340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:42.138973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:42.139255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:42.139527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:42.140205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:42.140508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:42.142070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:42.151553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 83/162] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:42.158056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21fca-81a5-494f-82f5-055a4480dc12 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:42.172649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:42.204674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:42.226687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:42.366634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3c3f-cf7d-4f2d-8ddb-cb2e3343f529 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:42.402339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:42.403561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21fca-81a5-494f-82f5-055a4480dc12 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:42.403710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:42.403879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:42.404130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:42.415824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:42.423563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:42.424483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:42.425247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 84/163] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:18:42.430936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:42.478779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:42.479356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:42.479636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:42.479908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] PATH_INFO: `/v3/users/55725fd30c284e01b807aa482bab0655` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:42.483314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] RBAC: Authorizing `identity:get_user(user_id=55725fd30c284e01b807aa482bab0655)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:42.484859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:42.486580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 80/164] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:42 2022] GET /identity/v3/users/55725fd30c284e01b807aa482bab0655 => generated 247 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:42.504309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:42.536894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:42.547309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbceb57-9497-47bf-9013-9b527ca3efe8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:42.587579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:42.588204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:42.588484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:42.588756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:42.589453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:42.589801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:42.591976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:42.600731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 85/165] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:42.607071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:42.633741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:42.645396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120d139-b10c-42ec-a284-6545c2d1a742 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:42.698628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:42.699254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:42.699624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:42.699847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:42.754549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d73cd-6895-4127-a007-1e5977e2f9b1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:42.805473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:42.807358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:42.815363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:42.816289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:42.816860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:42.817302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:42.820521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:42.822392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:42.825787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 86/166] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:42 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:42.831771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:42.868209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:42.938741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:42.960824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 81/167] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:42.962026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:43.087605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c49bb-af29-4318-855f-1a645ba7f351 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:43.144961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ff8c-c9bc-402e-9aa4-268293650384 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:43.173470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:43.174100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:43.174381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:43.174648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:43.215356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:43.216108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:43.216392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:43.216666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:43.220450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:43.221974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:43.223784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 82/168] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:42 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:43.229897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:43.326700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:43.337132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:43.338694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:43.377669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:43.409102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fd96-9f32-4a9c-a9f4-75b3c0848f4d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:43.478093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747fdb3-4535-43f1-a582-b4d6477c5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:43.478718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747fdb3-4535-43f1-a582-b4d6477c5af6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:43.478996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747fdb3-4535-43f1-a582-b4d6477c5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:43.479270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747fdb3-4535-43f1-a582-b4d6477c5af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:43.480007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747fdb3-4535-43f1-a582-b4d6477c5af6 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=55725fd30c284e01b807aa482bab0655) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:43.480315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747fdb3-4535-43f1-a582-b4d6477c5af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:43.481890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747fdb3-4535-43f1-a582-b4d6477c5af6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:43.499520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 83/169] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:43 2022] GET /identity/v3/role_assignments?user.id=55725fd30c284e01b807aa482bab0655&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:43.500886 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fb86-7ad5-4c47-b634-903a1bbee759 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:43.501171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fb86-7ad5-4c47-b634-903a1bbee759 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:43.501470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fb86-7ad5-4c47-b634-903a1bbee759 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:43.502782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 84/170] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:43.508362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344a34-b00b-4633-9965-80ce46fd359f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:43.508686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344a34-b00b-4633-9965-80ce46fd359f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:43.509172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344a34-b00b-4633-9965-80ce46fd359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:43.529173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 87/171] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:18:43.535389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:43.553173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-15344a34-b00b-4633-9965-80ce46fd359f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:43.554542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-15344a34-b00b-4633-9965-80ce46fd359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:43.720275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 85/172] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:43.749843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87cd39-a4cb-44bb-a473-6f65dda128ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:43.762057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344a34-b00b-4633-9965-80ce46fd359f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:43.784308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:43.813481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:43.814152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:43.814427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:43.814697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:43.819376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:43.820880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:43.823081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 88/173] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:43 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:43.830436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:43.856291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:43.922976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344a34-b00b-4633-9965-80ce46fd359f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:43.958060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:43.958713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:43.958991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:43.959262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:43.970160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:43.974986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:43.975826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:43.976597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 86/174] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:43.982138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.085882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063232-7dc0-4a3c-a8a1-4aa23f2c5b35 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.102503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.107979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dabfc-644e-4def-aee0-79e0f4b55e31 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.128044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d478a7-128d-4d67-9982-fe2d629e092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.128675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d478a7-128d-4d67-9982-fe2d629e092d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.128953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d478a7-128d-4d67-9982-fe2d629e092d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.129223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d478a7-128d-4d67-9982-fe2d629e092d None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.129949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d478a7-128d-4d67-9982-fe2d629e092d None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:44.130252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d478a7-128d-4d67-9982-fe2d629e092d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:44.131669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d478a7-128d-4d67-9982-fe2d629e092d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:44.155887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 87/175] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:44.158013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493861f-341e-4754-a12e-84635e86f013 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.160010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493861f-341e-4754-a12e-84635e86f013 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.160798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493861f-341e-4754-a12e-84635e86f013 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.164477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 88/176] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:44.165498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493861f-341e-4754-a12e-84635e86f013 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.185624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7ed78-9ad3-475c-bc8b-2f9611f2630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.186668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ed78-9ad3-475c-bc8b-2f9611f2630f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.187189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ed78-9ad3-475c-bc8b-2f9611f2630f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.188121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ed78-9ad3-475c-bc8b-2f9611f2630f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.189070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ed78-9ad3-475c-bc8b-2f9611f2630f None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=dff8474fbe1e4c859a1f366802002642) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:44.190701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ed78-9ad3-475c-bc8b-2f9611f2630f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:44.192372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ed78-9ad3-475c-bc8b-2f9611f2630f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:44.210298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 89/177] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:43 2022] GET /identity/v3/role_assignments?user.id=dff8474fbe1e4c859a1f366802002642&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 608 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:44.211949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1026-8b51-4b08-b06a-e0fb0607c170 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.212654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1026-8b51-4b08-b06a-e0fb0607c170 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.216022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1026-8b51-4b08-b06a-e0fb0607c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.246498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2aed1026-8b51-4b08-b06a-e0fb0607c170 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:44.248124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2aed1026-8b51-4b08-b06a-e0fb0607c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:44.308295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493861f-341e-4754-a12e-84635e86f013 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.322973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.345836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 90/178] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:44.347171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4edc85-ecf6-43f7-8ddb-306fc825679f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.353387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4edc85-ecf6-43f7-8ddb-306fc825679f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.353387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4edc85-ecf6-43f7-8ddb-306fc825679f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.353387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 91/179] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:44.353387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05a73-481b-4ba1-816b-a8bd4495e130 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.353387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05a73-481b-4ba1-816b-a8bd4495e130 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.353387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e05a73-481b-4ba1-816b-a8bd4495e130 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.353387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 92/180] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:44.357769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3ada4-95a4-45fc-acb6-71ec3d4794c9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.358052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3ada4-95a4-45fc-acb6-71ec3d4794c9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.358330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3ada4-95a4-45fc-acb6-71ec3d4794c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.362990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beba4e9-ff6f-4e22-a2fa-32eab6197b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.363835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba4e9-ff6f-4e22-a2fa-32eab6197b73 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.364250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba4e9-ff6f-4e22-a2fa-32eab6197b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.364746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba4e9-ff6f-4e22-a2fa-32eab6197b73 None admin] PATH_INFO: `/v3/users/dff8474fbe1e4c859a1f366802002642` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.366187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beba4e9-ff6f-4e22-a2fa-32eab6197b73 None admin] RBAC: Authorizing `identity:get_user(user_id=dff8474fbe1e4c859a1f366802002642)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:44.367844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beba4e9-ff6f-4e22-a2fa-32eab6197b73 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:44.369727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 89/181] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:44 2022] GET /identity/v3/users/dff8474fbe1e4c859a1f366802002642 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:44.371435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d6afb-a780-4e25-b330-53a1297a45bb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.371911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d6afb-a780-4e25-b330-53a1297a45bb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.372354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d6afb-a780-4e25-b330-53a1297a45bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.387859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-37d3ada4-95a4-45fc-acb6-71ec3d4794c9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:44.389106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-37d3ada4-95a4-45fc-acb6-71ec3d4794c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:44.391980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c54d6afb-a780-4e25-b330-53a1297a45bb None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:44.393543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c54d6afb-a780-4e25-b330-53a1297a45bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:44.446156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.467021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 93/182] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:44.467981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3ada4-95a4-45fc-acb6-71ec3d4794c9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.470440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 90/183] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:44.471814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d6afb-a780-4e25-b330-53a1297a45bb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.579930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d6afb-a780-4e25-b330-53a1297a45bb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.581559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3ada4-95a4-45fc-acb6-71ec3d4794c9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.594333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.613199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124667-0bfd-4770-926d-be76a8483fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.613879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124667-0bfd-4770-926d-be76a8483fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.614160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124667-0bfd-4770-926d-be76a8483fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.614434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124667-0bfd-4770-926d-be76a8483fb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.617335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.617983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.618251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.618519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.626791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05124667-0bfd-4770-926d-be76a8483fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-05124667-0bfd-4770-926d-be76a8483fb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:44.631566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:44.632578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:44.633540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 91/184] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:44.634337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852f6a-c595-4391-9df7-b5fe9524ff08 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.634577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852f6a-c595-4391-9df7-b5fe9524ff08 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.634778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852f6a-c595-4391-9df7-b5fe9524ff08 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.635980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 92/185] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:44.637974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99852f6a-c595-4391-9df7-b5fe9524ff08 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.668048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.691416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:44.692888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:44.743930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99852f6a-c595-4391-9df7-b5fe9524ff08 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.781875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.782505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.782782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.783049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.784179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:44.785667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:44.787242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 93/186] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:44.792013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.799630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 94/187] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:44.800500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.816545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.885623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.889403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8921712-e42d-4c3d-be3a-38fb9b5fbd3a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.903145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdfdc8-7aa4-476f-869e-33cf45e3d583 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:44.922510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e11a68-48ee-4872-b9d6-f2162fce2932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.923178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11a68-48ee-4872-b9d6-f2162fce2932 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.923453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11a68-48ee-4872-b9d6-f2162fce2932 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.923719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11a68-48ee-4872-b9d6-f2162fce2932 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.933478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e11a68-48ee-4872-b9d6-f2162fce2932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:44.935732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:44.936342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.936619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.936888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.937579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:44.937882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f2e11a68-48ee-4872-b9d6-f2162fce2932 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:44.938620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:44.939464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:44.940236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:44.940825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:44.940894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 94/188] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:44.940894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13ce9-a7af-4c38-884e-1e5da1de640e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:44.941115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13ce9-a7af-4c38-884e-1e5da1de640e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:44.941613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13ce9-a7af-4c38-884e-1e5da1de640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:44.957205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 95/189] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:44.957205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:44.959400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7cf13ce9-a7af-4c38-884e-1e5da1de640e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:44.960604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7cf13ce9-a7af-4c38-884e-1e5da1de640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:45.026709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 95/190] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:45.027513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf13ce9-a7af-4c38-884e-1e5da1de640e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.028870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.063675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae628e0-2344-4a9b-aaa5-fbdabb7ad339 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.097237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.097880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.098157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.098802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.099486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.101286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.110702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.123905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf13ce9-a7af-4c38-884e-1e5da1de640e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.124077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 96/191] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:18:44 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:45.125015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.172074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.172710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.173103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.173467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] PATH_INFO: `/v3/projects/b8eb856623844df8831c4532b9f18009` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.177406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] RBAC: Authorizing `identity:get_project(project_id=b8eb856623844df8831c4532b9f18009)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.177406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.178710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 96/192] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/projects/b8eb856623844df8831c4532b9f18009 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:45.179342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.249842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100dca-0c34-459b-b467-7a2036a358f3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.281112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.290841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb592e-cc60-4213-a6d8-eb89792908f3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.291002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.291477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.291756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.292079 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.292732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:45.293081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.295525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.307290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 97/193] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:45.308239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.344113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.344758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.347425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.347425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] PATH_INFO: `/v3/users/060fb4e4954745afa8077438ffaebcc9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.359595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] RBAC: Authorizing `identity:get_user(user_id=060fb4e4954745afa8077438ffaebcc9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.361291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.363288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 97/194] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/users/060fb4e4954745afa8077438ffaebcc9 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:45.368471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.387581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.436822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0aebe-e3b1-43cf-bc54-a747e4df88e3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.489622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.490279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.490561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.490837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.502344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c857e0-cdec-41a1-9cf4-29b9d38aa59b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.502548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:45.507899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:45.508829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 98/195] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:45.509967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.554098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.554629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.555367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.555650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.556788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=b8eb856623844df8831c4532b9f18009, user.id=dff8474fbe1e4c859a1f366802002642) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:45.557104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.559071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.566827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 98/196] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/role_assignments?user.id=dff8474fbe1e4c859a1f366802002642&scope.project.id=b8eb856623844df8831c4532b9f18009&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:45.567797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.570066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.669022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a712ec-7dd8-4c60-a1ed-644d9a3e67f9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.734527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.740486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.741159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.741712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.742371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] PATH_INFO: `/v3/users/c4829797ea1e4b48acf7950bfc5021a1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.746688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] RBAC: Authorizing `identity:get_user(user_id=c4829797ea1e4b48acf7950bfc5021a1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.748205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.753945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 99/197] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/users/c4829797ea1e4b48acf7950bfc5021a1 => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:45.753945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:45.765023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b2671-95f4-4b40-95c0-2a81e6eac829 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.808881 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.809651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.809939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.810258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.891613 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7103b60-3dde-4016-9f75-c028ea949155 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:45.900195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.902316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.923932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.944751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:45.945733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:45.946777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:45.947262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:45.948120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:45.948598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:45.950691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:45.959778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 100/198] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:45.961567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.017826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:46.046491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 99/199] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:46.047162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.093289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff69ab9-0631-454f-9ad9-6cd20489a2b1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.140040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.140723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.140951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.141194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.158036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fc7e1-3628-4ba4-b3f4-e3dbe0ad326a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.192590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.194279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.194760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.195241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] PATH_INFO: `/v3/users/060fb4e4954745afa8077438ffaebcc9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.196638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] RBAC: Authorizing `identity:get_user(user_id=060fb4e4954745afa8077438ffaebcc9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.198447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.201195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 100/200] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/users/060fb4e4954745afa8077438ffaebcc9 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:46.202426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.205847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:46.234133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.236238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.259782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:46.316271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02519c1-e063-4c18-bba3-d6e881770c31 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.351543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.352732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.353208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.355177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.356286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 101/201] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:46.356933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.357966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.360064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 101/202] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:46.366145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.444262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:46.463836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4046-7544-46d3-b653-8dacd5742624 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.479322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad831-cfc5-401f-98b5-8383d72a4455 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.494959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:46.501492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.502325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.502740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.503142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.519321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.520612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.520995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.521674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.523162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.525235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.527751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 102/203] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:46.528616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.583758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.585397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.654933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce888a13-4ff1-4208-a400-db5a86503ff7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.671818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:46.698472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.703497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 102/204] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:46.703497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.704656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.705156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.705641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.706567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=060fb4e4954745afa8077438ffaebcc9) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:46.707064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.708735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.714945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 103/205] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/role_assignments?user.id=060fb4e4954745afa8077438ffaebcc9&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:46.715943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.811199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:46.877733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a3cc5-b4f6-4003-9755-569352144a2c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.916377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.917430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.917904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.918464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.920148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.922038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.924555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 104/206] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:46.931100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:46.934055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526c7c-5098-40f4-8a0d-2e54855dbe65 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:46.983391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686ae3d-df12-4db5-a413-abad5f7178a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:46.984017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ae3d-df12-4db5-a413-abad5f7178a1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:46.984297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ae3d-df12-4db5-a413-abad5f7178a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:46.984572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ae3d-df12-4db5-a413-abad5f7178a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:46.985309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ae3d-df12-4db5-a413-abad5f7178a1 None admin] RBAC: Adding query filter params (role.id=dbab5115a54f48bca375041930970192, scope.project.id=14a696a642e44af38cba2ff089f73072, user.id=c4829797ea1e4b48acf7950bfc5021a1) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:46.986989 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ae3d-df12-4db5-a413-abad5f7178a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:46.988243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ae3d-df12-4db5-a413-abad5f7178a1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:46.994825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 103/207] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/role_assignments?user.id=c4829797ea1e4b48acf7950bfc5021a1&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=dbab5115a54f48bca375041930970192 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:47.065351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a44dfa-cfc6-4ac8-af96-b13af72a0c92 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:47.090080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:47.113680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6288a-2f06-4560-bb86-f267336fbb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:47.114379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6288a-2f06-4560-bb86-f267336fbb1d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.114663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6288a-2f06-4560-bb86-f267336fbb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.114944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6288a-2f06-4560-bb86-f267336fbb1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.115705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6288a-2f06-4560-bb86-f267336fbb1d None admin] RBAC: Adding query filter params (role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=060fb4e4954745afa8077438ffaebcc9) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:47.116013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6288a-2f06-4560-bb86-f267336fbb1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:47.117533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6288a-2f06-4560-bb86-f267336fbb1d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:47.125195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 105/208] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:46 2022] GET /identity/v3/role_assignments?user.id=060fb4e4954745afa8077438ffaebcc9&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=d138e21392054605846b1a7ee19e3814 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:47.330676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29b616-757d-4f4e-8b10-64e1abf783b5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.331204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29b616-757d-4f4e-8b10-64e1abf783b5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.331204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29b616-757d-4f4e-8b10-64e1abf783b5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.332744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 104/209] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:47.338598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472a89-f41c-4b55-a908-f4dc93b25459 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.339532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472a89-f41c-4b55-a908-f4dc93b25459 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.340059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472a89-f41c-4b55-a908-f4dc93b25459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.362113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-64472a89-f41c-4b55-a908-f4dc93b25459 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:47.363368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-64472a89-f41c-4b55-a908-f4dc93b25459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:47.444698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 106/210] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:47.470131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29b616-757d-4f4e-8b10-64e1abf783b5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:47.531392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:47.577157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f50b-6cc1-4ff2-8e24-68cd69a44d83 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.577818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f50b-6cc1-4ff2-8e24-68cd69a44d83 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.578309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f50b-6cc1-4ff2-8e24-68cd69a44d83 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.581011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 107/211] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:47.586242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91af7c0-dfda-4ca4-b940-9c5e093e6e55 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.586761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91af7c0-dfda-4ca4-b940-9c5e093e6e55 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.587232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91af7c0-dfda-4ca4-b940-9c5e093e6e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.597193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29b616-757d-4f4e-8b10-64e1abf783b5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:47.611850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b91af7c0-dfda-4ca4-b940-9c5e093e6e55 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:47.617326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b91af7c0-dfda-4ca4-b940-9c5e093e6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:47.632720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:47.633409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.633699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.633959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.646823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:47.652187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:47.653331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:47.654318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 105/212] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:47.659878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:47.698921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 108/213] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:47.723033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91af7c0-dfda-4ca4-b940-9c5e093e6e55 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:47.763624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:47.783298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178fb20-64ac-4700-abf4-8e78f7348bbe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:47.797843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:47.827029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91af7c0-dfda-4ca4-b940-9c5e093e6e55 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:47.827207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:47.828073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.828702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.829938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.830838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:47.831393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:47.833003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:47.844374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 106/214] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:47.850576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:47.863593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:47.864315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:47.864657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:47.864996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:47.866275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:47.867966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:47.869751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 109/215] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:47.875462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:47.968168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baafeb-f088-4f00-b1b4-e11cf3e7a112 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:48.000919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d9145-a426-410e-8c7e-10fb1cddfd65 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:48.007917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:48.008670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.009013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.009354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] PATH_INFO: `/v3/users/ca97003d23944fd78a4237dc603ebebf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.010792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.028095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] RBAC: Authorizing `identity:get_user(user_id=ca97003d23944fd78a4237dc603ebebf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:48.030767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:48.033949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 107/216] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:47 2022] GET /identity/v3/users/ca97003d23944fd78a4237dc603ebebf => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:48.040608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:48.048613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:48.049237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.049575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.049848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.050582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:48.052068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:48.079275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.081259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 110/217] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:18:47 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:18:48.167819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de6e9-6fd0-421f-b86a-b6c959161982 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:48.207055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:48.208373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.208853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.209318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.282721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:48.284186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:48.311425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.392998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 108/218] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:48.399054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:48.514076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fa37-beec-4641-b305-87d9430c965c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:48.551271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eca27f-4f7b-4b3f-819a-c62cd560b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:48.551910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eca27f-4f7b-4b3f-819a-c62cd560b543 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.552185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eca27f-4f7b-4b3f-819a-c62cd560b543 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.552453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eca27f-4f7b-4b3f-819a-c62cd560b543 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.553605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eca27f-4f7b-4b3f-819a-c62cd560b543 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:48.555059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eca27f-4f7b-4b3f-819a-c62cd560b543 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:48.556690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 111/219] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:48 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:48.562959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:48.679054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335959ae-2033-473a-9e02-dcc7ae484550 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:48.706631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.717033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a963af-0c13-44c2-89c1-99ecc4058864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:48.717685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a963af-0c13-44c2-89c1-99ecc4058864 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.718394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a963af-0c13-44c2-89c1-99ecc4058864 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.719084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a963af-0c13-44c2-89c1-99ecc4058864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.719817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a963af-0c13-44c2-89c1-99ecc4058864 None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=ca97003d23944fd78a4237dc603ebebf) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:48.720121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a963af-0c13-44c2-89c1-99ecc4058864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:48.721697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a963af-0c13-44c2-89c1-99ecc4058864 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:48.727826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 109/220] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:48 2022] GET /identity/v3/role_assignments?user.id=ca97003d23944fd78a4237dc603ebebf&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:49.051851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ad4ca-0298-471b-afb0-00a7c0c96e91 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.052189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ad4ca-0298-471b-afb0-00a7c0c96e91 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.052440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ad4ca-0298-471b-afb0-00a7c0c96e91 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.053860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 112/221] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:49.059607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a181-7b6e-4a0a-b146-daa6e3e635ea None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.059977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a181-7b6e-4a0a-b146-daa6e3e635ea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.060313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a181-7b6e-4a0a-b146-daa6e3e635ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.079606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-23f6a181-7b6e-4a0a-b146-daa6e3e635ea None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:49.080794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-23f6a181-7b6e-4a0a-b146-daa6e3e635ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:49.150223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 110/222] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:49.172259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ad4ca-0298-471b-afb0-00a7c0c96e91 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:49.205485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:49.312108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ad4ca-0298-471b-afb0-00a7c0c96e91 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:49.362114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5609e-b675-4399-a38b-51b0ba9a4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:49.362790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5609e-b675-4399-a38b-51b0ba9a4c77 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.363114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5609e-b675-4399-a38b-51b0ba9a4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.363390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5609e-b675-4399-a38b-51b0ba9a4c77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.376564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5609e-b675-4399-a38b-51b0ba9a4c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c2a5609e-b675-4399-a38b-51b0ba9a4c77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:49.381637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:49.382474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:49.383234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 113/223] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:49.389000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a181-7b6e-4a0a-b146-daa6e3e635ea None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:49.496321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb79bb-e69d-4e13-a552-132f7deb1cdc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.496844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb79bb-e69d-4e13-a552-132f7deb1cdc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.496946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb79bb-e69d-4e13-a552-132f7deb1cdc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.498322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 114/224] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:49.503604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0817-a065-4957-af5a-2d3b776642ea None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.503882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0817-a065-4957-af5a-2d3b776642ea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.504377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0817-a065-4957-af5a-2d3b776642ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.507566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a181-7b6e-4a0a-b146-daa6e3e635ea None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:49.528847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:49.546352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2e5b0817-a065-4957-af5a-2d3b776642ea None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:49.547904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2e5b0817-a065-4957-af5a-2d3b776642ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:49.551018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:49.551631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.551905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.552232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.552896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:49.553264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:49.554719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:49.568954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 111/225] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:49.574791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:49.668919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 115/226] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:49.710997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0817-a065-4957-af5a-2d3b776642ea None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:49.733418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4daf51-99a5-4408-b3f3-f56d81191184 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:49.757939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:49.769949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:49.770680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.770912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.771180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] PATH_INFO: `/v3/users/060fb4e4954745afa8077438ffaebcc9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.772341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] RBAC: Authorizing `identity:get_user(user_id=060fb4e4954745afa8077438ffaebcc9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:49.773817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:49.775421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 112/227] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:49 2022] GET /identity/v3/users/060fb4e4954745afa8077438ffaebcc9 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:49.781046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:49.833207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:49.883299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62edabf-d938-4352-a73c-7ab4cf25c26a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:49.916573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:49.917434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:49.917891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:49.918299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:49.919593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:49.921307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:49.923410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 113/228] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:49 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:49.929273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:49.948297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0817-a065-4957-af5a-2d3b776642ea None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:50.017732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:50.018679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.019106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.019512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.041265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:50.049112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:50.050028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:50.050781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:50.053187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 116/229] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:18:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:18:50.061964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:50.106739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cfcc6-1074-45f5-9642-b5cf119e2f42 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:50.144852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:50.174246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:50.174929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.175214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.175483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/060fb4e4954745afa8077438ffaebcc9/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.179563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] RBAC: Authorizing `identity:create_grant(project_id=1622a1b2569948e4a8c2c82f66024821, user_id=060fb4e4954745afa8077438ffaebcc9, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:50.185557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:50.195272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:50.209887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 114/230] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:49 2022] PUT /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/060fb4e4954745afa8077438ffaebcc9/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:18:50.225668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881054b-dbf3-4298-a2c3-4c923c45f924 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:50.267209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:50.268009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.268351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.268626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.269379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:50.269700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:50.271185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:50.285527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 117/231] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:18:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:50.287694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:50.438794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2acb28-0cff-42e7-8790-6b1ec3634550 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:50.477752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c1a2a-5b98-4f3b-ae8b-9b182ddf738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:50.478402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1a2a-5b98-4f3b-ae8b-9b182ddf738b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.478682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1a2a-5b98-4f3b-ae8b-9b182ddf738b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.478954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1a2a-5b98-4f3b-ae8b-9b182ddf738b None admin] PATH_INFO: `/v3/users/060fb4e4954745afa8077438ffaebcc9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.480092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c1a2a-5b98-4f3b-ae8b-9b182ddf738b None admin] RBAC: Authorizing `identity:get_user(user_id=060fb4e4954745afa8077438ffaebcc9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:50.481743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c1a2a-5b98-4f3b-ae8b-9b182ddf738b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:50.486198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 115/232] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:50 2022] GET /identity/v3/users/060fb4e4954745afa8077438ffaebcc9 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:50.489649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:50.599179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd7f7-6ad7-40dd-a995-45f2251f06ba None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:50.657806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:50.658462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.658750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.659025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.660214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:50.661722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:50.663728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 118/233] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:50 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:50.667368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ffaa5-bdde-4892-9128-e120935c3ff4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.667861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ffaa5-bdde-4892-9128-e120935c3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.667965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ffaa5-bdde-4892-9128-e120935c3ff4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.669451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 116/234] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:50.673421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:50.679475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80e3e2-7556-4b7a-b571-0bb7bb777a68 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.679763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80e3e2-7556-4b7a-b571-0bb7bb777a68 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.680046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80e3e2-7556-4b7a-b571-0bb7bb777a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.698181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:50.708754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bc80e3e2-7556-4b7a-b571-0bb7bb777a68 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:50.709992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bc80e3e2-7556-4b7a-b571-0bb7bb777a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:50.788043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:50.810929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 117/235] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 08 02:18:50.814643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cc5a1-ec50-4ef5-bc6d-9c460dcb006d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.814925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cc5a1-ec50-4ef5-bc6d-9c460dcb006d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.815194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cc5a1-ec50-4ef5-bc6d-9c460dcb006d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.816703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 118/236] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:50.825160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61895ddc-7322-4f4f-a3a2-7e6e0f084886 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.825160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61895ddc-7322-4f4f-a3a2-7e6e0f084886 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.825824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61895ddc-7322-4f4f-a3a2-7e6e0f084886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.848197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35846c5c-c4cf-4ee5-80f3-571bbae5cac0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:50.854842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-61895ddc-7322-4f4f-a3a2-7e6e0f084886 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:50.856288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-61895ddc-7322-4f4f-a3a2-7e6e0f084886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:50.887525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:50.888095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:50.888371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:50.888648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/060fb4e4954745afa8077438ffaebcc9/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:50.891060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] RBAC: Authorizing `identity:create_grant(project_id=1622a1b2569948e4a8c2c82f66024821, user_id=060fb4e4954745afa8077438ffaebcc9, role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:50.892601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:50.908645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 119/237] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:50 2022] PUT /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/060fb4e4954745afa8077438ffaebcc9/roles/d138e21392054605846b1a7ee19e3814 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:50.918915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:50.961526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 119/238] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:51.008401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61895ddc-7322-4f4f-a3a2-7e6e0f084886 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.033167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.086607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fe035-aabd-482c-9d89-874b81adf876 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.149612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.150573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.151067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.151516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.163322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:51.169531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:51.170402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:51.171217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:51.174543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 120/239] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:51.178009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61895ddc-7322-4f4f-a3a2-7e6e0f084886 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.179858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.187491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.221716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.222642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.223082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.223509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.224800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:51.226429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:51.228609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 120/240] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:51.243284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.297542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e425-9d34-40c3-a250-83745346f5de None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.327399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.346619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.347246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.347529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.347800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.348477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:51.348777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:51.350211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:51.372560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 121/241] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:51.382360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.406454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492b31-5929-4130-a11f-746cd6c1064b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.442595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edcd91-090e-4756-90b5-c477e466933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.443306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edcd91-090e-4756-90b5-c477e466933e None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.443674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edcd91-090e-4756-90b5-c477e466933e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.444014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edcd91-090e-4756-90b5-c477e466933e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.444729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edcd91-090e-4756-90b5-c477e466933e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:51.446292 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edcd91-090e-4756-90b5-c477e466933e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:51.477866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 121/242] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:18:51 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:18:51.479278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5625-2c5d-473a-9fec-74de366dbfcb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.479692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5625-2c5d-473a-9fec-74de366dbfcb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.480034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5625-2c5d-473a-9fec-74de366dbfcb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.481693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 122/243] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:51.488210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6084b-8788-472f-8a6f-8a962720764d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.488591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6084b-8788-472f-8a6f-8a962720764d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.488937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6084b-8788-472f-8a6f-8a962720764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.511431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2bf6084b-8788-472f-8a6f-8a962720764d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:51.513159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2bf6084b-8788-472f-8a6f-8a962720764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:51.546910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.548761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfcee-91a3-454c-85a1-0d0f689ed11a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.602451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 123/244] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:51.638490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6084b-8788-472f-8a6f-8a962720764d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.662199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.662901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.663129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.663401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] PATH_INFO: `/v3/users/fa7ecf9353a240f6a2a0782949965fb7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.702781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] RBAC: Authorizing `identity:get_user(user_id=fa7ecf9353a240f6a2a0782949965fb7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:51.704291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:51.706051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 122/245] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:51 2022] GET /identity/v3/users/fa7ecf9353a240f6a2a0782949965fb7 => generated 297 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:51.712235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.751746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6084b-8788-472f-8a6f-8a962720764d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.789882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.796211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.797349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.797809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.798228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.812138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:51.819269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:51.820112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:51.820976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:51.823357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 124/246] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:18:51.829884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.863744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.865731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aeb57-9833-46eb-b15d-698e5f18a46e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.916840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.917514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.917814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.918085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.978005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2853f-e0f1-4f3b-a8d1-24505546b1ab None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:52.010478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:52.011878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:52.034142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:52.035127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.035624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.036099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.036962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:52.037529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:52.039174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:52.050253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 125/247] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:52.056165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:52.068198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:52.132931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 123/248] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:52.139364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:52.158898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:52.182536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1365a96-c9af-4ba3-a801-bbee904dbc05 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:52.223026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:52.224024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.224499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.224962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] PATH_INFO: `/v3/users/ca97003d23944fd78a4237dc603ebebf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.226382 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ca97003d23944fd78a4237dc603ebebf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:52.228105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:52.229990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 126/249] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:52 2022] GET /identity/v3/users/ca97003d23944fd78a4237dc603ebebf => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:52.236697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:52.258080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722907b-f9a1-4eb2-a1ff-3a8d7a1ba3ea None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:52.301942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:52.302512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.302791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.303065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.304203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:52.305711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:52.307488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 124/250] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:52 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:52.316121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:52.339055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:52.372647 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758e88-77af-41fa-8e8e-c0e6c739e7f2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:52.448093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:52.448740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.449059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.451276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.452592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:52.455403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:52.457088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 127/251] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:52 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:52.466394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:52.473003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a14b-3e3c-4dd7-b73b-010354999a1a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:52.501449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:52.533090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951915b-a69b-42d4-b8c9-12ef15beae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:52.534630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951915b-a69b-42d4-b8c9-12ef15beae56 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.534630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951915b-a69b-42d4-b8c9-12ef15beae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.534630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951915b-a69b-42d4-b8c9-12ef15beae56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.535095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951915b-a69b-42d4-b8c9-12ef15beae56 None admin] RBAC: Adding query filter params (role.id=dbab5115a54f48bca375041930970192, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=fa7ecf9353a240f6a2a0782949965fb7) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:52.535410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951915b-a69b-42d4-b8c9-12ef15beae56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:52.536919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951915b-a69b-42d4-b8c9-12ef15beae56 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:52.547855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 125/252] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:52 2022] GET /identity/v3/role_assignments?user.id=fa7ecf9353a240f6a2a0782949965fb7&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=dbab5115a54f48bca375041930970192 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:52.624218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e486a-3ed5-4ff3-9703-1ea859be1b03 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:52.668252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2e62f-e75c-4117-9850-773ca7a063fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:52.669114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2e62f-e75c-4117-9850-773ca7a063fb None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.669429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2e62f-e75c-4117-9850-773ca7a063fb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.669705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2e62f-e75c-4117-9850-773ca7a063fb None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/ca97003d23944fd78a4237dc603ebebf/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.672209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2e62f-e75c-4117-9850-773ca7a063fb None admin] RBAC: Authorizing `identity:create_grant(project_id=1622a1b2569948e4a8c2c82f66024821, user_id=ca97003d23944fd78a4237dc603ebebf, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:52.673718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2e62f-e75c-4117-9850-773ca7a063fb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:52.703183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 128/253] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:52 2022] PUT /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/ca97003d23944fd78a4237dc603ebebf/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:52.735701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260b20-40ab-48e4-b5e2-5d471c5e0ae0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.736260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260b20-40ab-48e4-b5e2-5d471c5e0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.736463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260b20-40ab-48e4-b5e2-5d471c5e0ae0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.738018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 126/254] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:52.748919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46212-68da-484d-9e85-f8ea4fca38e6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.749567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46212-68da-484d-9e85-f8ea4fca38e6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.750071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46212-68da-484d-9e85-f8ea4fca38e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.775167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ebc46212-68da-484d-9e85-f8ea4fca38e6 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:52.777206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ebc46212-68da-484d-9e85-f8ea4fca38e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:52.860828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 129/255] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:52.899442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a260b20-40ab-48e4-b5e2-5d471c5e0ae0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:53.012269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:53.033241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a260b20-40ab-48e4-b5e2-5d471c5e0ae0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:53.072132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:53.072777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:53.073061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:53.073336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:53.088469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:53.093585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:53.094454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:53.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 127/256] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:53.101102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc46212-68da-484d-9e85-f8ea4fca38e6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:53.115718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:53.237582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc46212-68da-484d-9e85-f8ea4fca38e6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:53.284184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:53.284817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:53.285097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:53.285390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:53.286082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:53.286385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:53.287776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:53.301602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 130/257] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:53.306556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:53.493172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53894a-0445-4f19-bdda-ecbd51b873f5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:53.535479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762e4e-482b-47f8-a457-9de2dab363fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:53.536174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762e4e-482b-47f8-a457-9de2dab363fc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:53.536461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762e4e-482b-47f8-a457-9de2dab363fc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:53.536739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762e4e-482b-47f8-a457-9de2dab363fc None admin] PATH_INFO: `/v3/users/060fb4e4954745afa8077438ffaebcc9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:53.537918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d762e4e-482b-47f8-a457-9de2dab363fc None admin] RBAC: Authorizing `identity:get_user(user_id=060fb4e4954745afa8077438ffaebcc9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:53.539545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d762e4e-482b-47f8-a457-9de2dab363fc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:53.541193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 128/258] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:53 2022] GET /identity/v3/users/060fb4e4954745afa8077438ffaebcc9 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:53.548075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:53.656054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:53.691568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5cba-0051-4fca-8df8-cd516462f012 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:53.736814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:53.737465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:53.737747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:53.738018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:53.755002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f22f00-2cb6-4997-9b05-61eeafff240d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:53.755912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f22f00-2cb6-4997-9b05-61eeafff240d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:53.756406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f22f00-2cb6-4997-9b05-61eeafff240d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:53.758018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 129/259] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:53.763464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fe3ad-deef-45dc-b8cb-6edf924fea37 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:53.763989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fe3ad-deef-45dc-b8cb-6edf924fea37 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:53.764479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fe3ad-deef-45dc-b8cb-6edf924fea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:53.803581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9f4fe3ad-deef-45dc-b8cb-6edf924fea37 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:53.809386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9f4fe3ad-deef-45dc-b8cb-6edf924fea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:53.819345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:53.820821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:53.823463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:53.930444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 130/260] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:53.957764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:53.997463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 131/261] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:54.002685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fe3ad-deef-45dc-b8cb-6edf924fea37 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:54.011805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:54.175062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a34d7-2ec4-4161-ac1d-004ae310e803 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:54.183252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fe3ad-deef-45dc-b8cb-6edf924fea37 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:54.216908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:54.217976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.218473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.218956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.220473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:54.222688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:54.224805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 132/262] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:54 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:54.231586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:54.270698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:54.271282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.271571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.271851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.290604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:54.298581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:54.300546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:54.304617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:54.305560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:54.306325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 131/263] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:18:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:54.317789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:54.407253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b8de-7769-4f8e-9fbd-9266e46ef3be None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:54.475526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86ee2-5ac9-4abb-adde-75a96e0ef923 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:54.477707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:54.478680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.479170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.479625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.480645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=060fb4e4954745afa8077438ffaebcc9) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:54.481147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:54.482811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:54.494832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 133/264] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:54 2022] GET /identity/v3/role_assignments?user.id=060fb4e4954745afa8077438ffaebcc9&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:54.533282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:54.533878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.534162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.534435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.535126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:54.535432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:54.536842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:54.550519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 132/265] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:54.556717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:54.718653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b46089-5b97-4446-90a7-83f57127597b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:54.720362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:54.765435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca017c45-41e1-49ab-a7ca-89160d623632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:54.766094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017c45-41e1-49ab-a7ca-89160d623632 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.766372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017c45-41e1-49ab-a7ca-89160d623632 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.766643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017c45-41e1-49ab-a7ca-89160d623632 None admin] PATH_INFO: `/v3/users/060fb4e4954745afa8077438ffaebcc9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.774114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca017c45-41e1-49ab-a7ca-89160d623632 None admin] RBAC: Authorizing `identity:get_user(user_id=060fb4e4954745afa8077438ffaebcc9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:54.775618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca017c45-41e1-49ab-a7ca-89160d623632 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:54.777751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 134/266] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:54 2022] GET /identity/v3/users/060fb4e4954745afa8077438ffaebcc9 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:54.783348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:54.879116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:54.932149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff4b8e-ff0f-4f6d-9e4c-02d9ef36c06c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:54.976132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe4b6c-794a-4d06-b534-1584a3645b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:54.976751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe4b6c-794a-4d06-b534-1584a3645b2b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.977033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe4b6c-794a-4d06-b534-1584a3645b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.977306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe4b6c-794a-4d06-b534-1584a3645b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.072969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe4b6c-794a-4d06-b534-1584a3645b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:55.075133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe4b6c-794a-4d06-b534-1584a3645b2b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:55.130606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea017281-b9d0-482d-b779-c52cd997c069 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.131125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea017281-b9d0-482d-b779-c52cd997c069 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.131125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea017281-b9d0-482d-b779-c52cd997c069 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.132731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 135/267] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:55.145108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28496d8-1eba-4627-929f-67e62c83277e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.145429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28496d8-1eba-4627-929f-67e62c83277e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.145723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28496d8-1eba-4627-929f-67e62c83277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.160083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:55.181317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e28496d8-1eba-4627-929f-67e62c83277e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:55.182639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e28496d8-1eba-4627-929f-67e62c83277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:55.206213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 133/268] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:55.207499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c1f3-8b58-420d-a44a-ae5cfacfb3a3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.207846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c1f3-8b58-420d-a44a-ae5cfacfb3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.208122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c1f3-8b58-420d-a44a-ae5cfacfb3a3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.213514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 134/269] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:55.217858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c1f3-8b58-420d-a44a-ae5cfacfb3a3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:55.277187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 136/270] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:55.278687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca74f2-e8df-4bc9-9767-c67e5929ac45 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.278968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca74f2-e8df-4bc9-9767-c67e5929ac45 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.281566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca74f2-e8df-4bc9-9767-c67e5929ac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.302026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-29ca74f2-e8df-4bc9-9767-c67e5929ac45 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:55.303272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-29ca74f2-e8df-4bc9-9767-c67e5929ac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:55.332193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c1f3-8b58-420d-a44a-ae5cfacfb3a3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:55.367182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:55.367911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.368191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.368463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.369725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:55.371342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:55.372986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 135/271] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:55 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:55.373776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:55.383973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 137/272] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:55.384841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca74f2-e8df-4bc9-9767-c67e5929ac45 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:55.416631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:55.431912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:55.494196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca74f2-e8df-4bc9-9767-c67e5929ac45 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:55.506328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091064-cf44-40ba-bb9b-d7889b66a914 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:55.531141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:55.531788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.532160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.532431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.533152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] RBAC: Adding query filter params (role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=060fb4e4954745afa8077438ffaebcc9) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:55.533537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:55.535098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:55.543458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:55.544401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.544876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.545354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.546824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:55.547711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 138/273] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:55 2022] GET /identity/v3/role_assignments?user.id=060fb4e4954745afa8077438ffaebcc9&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=d138e21392054605846b1a7ee19e3814 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:55.548748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:55.548851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:55.550875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 136/274] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:55.560517 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:55.657766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:55.660782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7339-3062-47eb-9b78-fa30eaf05849 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:55.703105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465c00-b88a-4190-9711-ac1eb1fbe208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:55.703797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465c00-b88a-4190-9711-ac1eb1fbe208 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.704081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465c00-b88a-4190-9711-ac1eb1fbe208 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.704356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465c00-b88a-4190-9711-ac1eb1fbe208 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.716891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce465c00-b88a-4190-9711-ac1eb1fbe208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ce465c00-b88a-4190-9711-ac1eb1fbe208 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:55.724730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:55.725716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:55.726474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 139/275] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:55.727614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb398b-b60e-45a3-b1bc-b4047abc2101 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.727945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb398b-b60e-45a3-b1bc-b4047abc2101 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.728227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb398b-b60e-45a3-b1bc-b4047abc2101 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.729594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 140/276] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:55.734330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb398b-b60e-45a3-b1bc-b4047abc2101 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:55.737451 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:55.741908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99bd59-adb5-441e-bad3-8c7ab79772d4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:55.785677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c144ad-0485-4daa-a6c2-8881d9be368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:55.786423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c144ad-0485-4daa-a6c2-8881d9be368b None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.786560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c144ad-0485-4daa-a6c2-8881d9be368b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.786833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c144ad-0485-4daa-a6c2-8881d9be368b None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.787490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c144ad-0485-4daa-a6c2-8881d9be368b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:55.788972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c144ad-0485-4daa-a6c2-8881d9be368b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:55.816020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 137/277] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:18:55 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:55.818360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9359-ea3c-4c73-9ee7-049a450e7a99 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.818868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9359-ea3c-4c73-9ee7-049a450e7a99 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.819511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9359-ea3c-4c73-9ee7-049a450e7a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.845924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-04cd9359-ea3c-4c73-9ee7-049a450e7a99 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:55.848612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-04cd9359-ea3c-4c73-9ee7-049a450e7a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:55.873909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb398b-b60e-45a3-b1bc-b4047abc2101 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:55.919694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081368af-a54d-45a0-9f8b-c02ecd48cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:55.920248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081368af-a54d-45a0-9f8b-c02ecd48cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.920530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081368af-a54d-45a0-9f8b-c02ecd48cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.920805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081368af-a54d-45a0-9f8b-c02ecd48cfa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.921512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081368af-a54d-45a0-9f8b-c02ecd48cfa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:55.921818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081368af-a54d-45a0-9f8b-c02ecd48cfa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:55.923753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081368af-a54d-45a0-9f8b-c02ecd48cfa2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:55.937850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 141/278] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:55.939690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b2084-27e3-45e1-8968-22a38c4c0efa None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.940258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b2084-27e3-45e1-8968-22a38c4c0efa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.940790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b2084-27e3-45e1-8968-22a38c4c0efa None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.942533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 142/279] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:55.943826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b2084-27e3-45e1-8968-22a38c4c0efa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:55.951156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 138/280] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:55.952549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69e9a-b1c1-41b7-b11d-4501b4fc61e1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.952837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69e9a-b1c1-41b7-b11d-4501b4fc61e1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.953112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69e9a-b1c1-41b7-b11d-4501b4fc61e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.976673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:55.977918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d3a69e9a-b1c1-41b7-b11d-4501b4fc61e1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:55.979187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d3a69e9a-b1c1-41b7-b11d-4501b4fc61e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:56.060159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 139/281] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:56.061931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a69e9a-b1c1-41b7-b11d-4501b4fc61e1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.083710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:56.084876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b2084-27e3-45e1-8968-22a38c4c0efa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.132306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.132936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.133205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.133609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] PATH_INFO: `/v3/users/ef43b670bdce47568beb25dc238f650b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.152439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] RBAC: Authorizing `identity:get_user(user_id=ef43b670bdce47568beb25dc238f650b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:56.153852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:56.155919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 143/282] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:55 2022] GET /identity/v3/users/ef43b670bdce47568beb25dc238f650b => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:56.156711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.185007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a69e9a-b1c1-41b7-b11d-4501b4fc61e1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.224479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.225531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.226464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.226942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.241519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:56.248365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:56.250224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:56.251188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:18:56.253322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 140/283] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:56.254358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.258857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:56.287450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a68ed1-1f9b-4e82-85e1-4b0468370d65 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.324414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.325066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.325740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.326019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.336622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:56.341857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:56.342755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:56.343525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 144/284] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:56.344161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.365797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:56.378651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01695ae9-8a66-467d-8e31-05dcbbf32164 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.423722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.425599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.426112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.426581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.427508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, user.id=ef43b670bdce47568beb25dc238f650b, scope.system=all) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:56.428029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:56.430280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:56.437749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 141/285] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/role_assignments?user.id=ef43b670bdce47568beb25dc238f650b&scope.system=all&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:56.439135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.487894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b1de-10c1-4871-8789-4d1fa4c165f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.556061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdeedf-fef7-4dd1-ac4d-9cfdf42704da None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.597613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.597853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.598403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.598752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.599066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.599336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.599783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:56.600089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.600186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:56.600630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.601521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:56.601739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:56.602222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:56.603469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:56.605262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:56.616208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 142/286] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:56.621768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:56.630231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 145/287] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:56.638144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.640224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.805882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3270f-a6b9-4e79-b320-0a84e1d788d4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.830541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179b93d-ac8a-4564-b7ea-1d4312582a33 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.868928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.869585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.869862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.870134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] PATH_INFO: `/v3/users/fa7ecf9353a240f6a2a0782949965fb7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.871392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] RBAC: Authorizing `identity:get_user(user_id=fa7ecf9353a240f6a2a0782949965fb7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:56.872840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:56.875622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 146/288] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/users/fa7ecf9353a240f6a2a0782949965fb7 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:56.879419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.880057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.880338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.880610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] PATH_INFO: `/v3/users/ca97003d23944fd78a4237dc603ebebf` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.881937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.882836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] RBAC: Authorizing `identity:get_user(user_id=ca97003d23944fd78a4237dc603ebebf)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:56.884280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:56.885885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 143/289] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/users/ca97003d23944fd78a4237dc603ebebf => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:56.891309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.994136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:57.011231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:57.045146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b1db-9c47-4d79-8c9e-61806d1e287d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:57.083910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9523f-bbc8-4752-adec-79a7861123ea None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:57.094236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:57.094875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.095250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.095524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.124968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:57.125664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.125948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.126219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.127628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:57.129130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:57.134239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 147/290] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:57.136821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:57.213868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:57.218565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:57.301230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771e8f-c3c9-48f7-8e3c-692d4d8b8e71 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:57.331660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:57.337171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:57.337828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.338108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.338384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/fa7ecf9353a240f6a2a0782949965fb7/roles/dbab5115a54f48bca375041930970192` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.340587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] RBAC: Authorizing `identity:create_grant(project_id=1622a1b2569948e4a8c2c82f66024821, user_id=fa7ecf9353a240f6a2a0782949965fb7, role_id=dbab5115a54f48bca375041930970192)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:57.342499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:57.350541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:57.363484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 148/291] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:18:57 2022] PUT /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821/users/fa7ecf9353a240f6a2a0782949965fb7/roles/dbab5115a54f48bca375041930970192 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:18:57.407326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 144/292] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:57.413977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:57.522071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17d10-7462-4944-8afb-24975967237c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:57.558176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4adf-58cb-4795-ad06-c9fd0a4e980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:57.559361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4adf-58cb-4795-ad06-c9fd0a4e980b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.559871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4adf-58cb-4795-ad06-c9fd0a4e980b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.560696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4adf-58cb-4795-ad06-c9fd0a4e980b None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.562057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4adf-58cb-4795-ad06-c9fd0a4e980b None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:57.563766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4adf-58cb-4795-ad06-c9fd0a4e980b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:57.565653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 149/293] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:18:57 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:57.572718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:57.685298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e9aef-d535-4481-8fcf-afeb5643925b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:57.721677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388327-bdb9-40e1-9223-98ba312c887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:57.722289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388327-bdb9-40e1-9223-98ba312c887f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.722569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388327-bdb9-40e1-9223-98ba312c887f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.722844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388327-bdb9-40e1-9223-98ba312c887f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.723576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388327-bdb9-40e1-9223-98ba312c887f None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=ca97003d23944fd78a4237dc603ebebf) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:57.723884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388327-bdb9-40e1-9223-98ba312c887f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:57.725503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388327-bdb9-40e1-9223-98ba312c887f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:57.732439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 145/294] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:18:57 2022] GET /identity/v3/role_assignments?user.id=ca97003d23944fd78a4237dc603ebebf&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:58.111559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e19c00-a18a-447f-8202-a6d57b014e7b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.111935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e19c00-a18a-447f-8202-a6d57b014e7b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.112109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e19c00-a18a-447f-8202-a6d57b014e7b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.113767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 150/295] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:58.119184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49f1e-042f-4a21-8fbe-f5723a2fcba0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.119650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49f1e-042f-4a21-8fbe-f5723a2fcba0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.119725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49f1e-042f-4a21-8fbe-f5723a2fcba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.148304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c3c49f1e-042f-4a21-8fbe-f5723a2fcba0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:58.149598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c3c49f1e-042f-4a21-8fbe-f5723a2fcba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:58.181158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:58.233485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 146/296] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:58.260267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e19c00-a18a-447f-8202-a6d57b014e7b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:58.322995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:58.371154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e19c00-a18a-447f-8202-a6d57b014e7b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:58.380029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925030-54bf-45fb-b179-5abf87277b0a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.380693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925030-54bf-45fb-b179-5abf87277b0a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.381273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925030-54bf-45fb-b179-5abf87277b0a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.384269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 147/297] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:58.388833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e12d-8b78-4a89-8f36-7f5cd3d7781c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.389333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e12d-8b78-4a89-8f36-7f5cd3d7781c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.389830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e12d-8b78-4a89-8f36-7f5cd3d7781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.405937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:58.406580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.406862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.407133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.410089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e161e12d-8b78-4a89-8f36-7f5cd3d7781c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:58.411543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e161e12d-8b78-4a89-8f36-7f5cd3d7781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:58.418241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:58.423614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:58.424487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:58.430191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 151/298] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:58.432443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:58.493346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 148/299] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:18:58.516614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e12d-8b78-4a89-8f36-7f5cd3d7781c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:58.533882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d0f5-3da4-44a2-a819-aed16883ff3f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:58.553746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:58.568361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:58.569567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.569925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.570264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.571004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:58.571396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:58.572946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:58.583568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 152/300] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:58.589638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:58.615001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:58.624841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e12d-8b78-4a89-8f36-7f5cd3d7781c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:58.661076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:58.662043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.662483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.662904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.664192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:58.665840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:58.672725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 149/301] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:18:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:58.674209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:58.692122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbe7a-4404-4dcd-b37f-598df61bcb30 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:58.727130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2f2a2-865c-4872-b1e0-9bb1e92b218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:58.727885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f2a2-865c-4872-b1e0-9bb1e92b218a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.728231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f2a2-865c-4872-b1e0-9bb1e92b218a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.728569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f2a2-865c-4872-b1e0-9bb1e92b218a None admin] PATH_INFO: `/v3/users/9d3f9cef417342a4b93c716f6b18407d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.742398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f2a2-865c-4872-b1e0-9bb1e92b218a None admin] RBAC: Authorizing `identity:get_user(user_id=9d3f9cef417342a4b93c716f6b18407d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:58.744002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f2a2-865c-4872-b1e0-9bb1e92b218a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:58.745964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 153/302] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:58 2022] GET /identity/v3/users/9d3f9cef417342a4b93c716f6b18407d => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:58.747441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c5c6-15fb-4b7d-911d-71ee96ae0e45 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.747791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c5c6-15fb-4b7d-911d-71ee96ae0e45 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.748130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c5c6-15fb-4b7d-911d-71ee96ae0e45 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.749425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 154/303] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:58.752387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c5c6-15fb-4b7d-911d-71ee96ae0e45 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:58.781826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280f623-59d9-4d85-9a20-e3da875bf2c8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:58.797635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:58.817413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56007b00-6658-4fe3-a0c7-7a3057228180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:58.818006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56007b00-6658-4fe3-a0c7-7a3057228180 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.818294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56007b00-6658-4fe3-a0c7-7a3057228180 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.818567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56007b00-6658-4fe3-a0c7-7a3057228180 None admin] PATH_INFO: `/v3/groups` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.819202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56007b00-6658-4fe3-a0c7-7a3057228180 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:58.820657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56007b00-6658-4fe3-a0c7-7a3057228180 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:58.840067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 150/304] 10.222.0.25 () {60 vars in 1134 bytes} [Mon Aug 8 02:18:58 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:18:58.841676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7e53d-cea6-41dd-be3d-c0aba3eb5812 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.841928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7e53d-cea6-41dd-be3d-c0aba3eb5812 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.842442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7e53d-cea6-41dd-be3d-c0aba3eb5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.864231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f7f7e53d-cea6-41dd-be3d-c0aba3eb5812 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:58.865637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f7f7e53d-cea6-41dd-be3d-c0aba3eb5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:58.883953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c5c6-15fb-4b7d-911d-71ee96ae0e45 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:58.889390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:58.926616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:58.927301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.927586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.927911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.928665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] RBAC: Adding query filter params (role.id=dbab5115a54f48bca375041930970192, user.id=9d3f9cef417342a4b93c716f6b18407d, scope.system=all) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:58.928977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:58.930611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:58.941936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 155/305] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Aug 8 02:18:58 2022] GET /identity/v3/role_assignments?user.id=9d3f9cef417342a4b93c716f6b18407d&scope.system=all&role.id=dbab5115a54f48bca375041930970192 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:18:58.973454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 151/306] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:58.995499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:59.110942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14579319-fd64-418c-a7ce-a9a0594290f2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:59.113677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:59.147289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:59.148231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:59.148673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:59.149110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:59.160047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:18:59.165090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:18:59.166193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:18:59.167156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:18:59.169493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 156/307] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:18:59.177399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7e53d-cea6-41dd-be3d-c0aba3eb5812 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:59.278930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7e53d-cea6-41dd-be3d-c0aba3eb5812 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:59.314915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:59.315548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:59.315830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:59.316107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:59.316795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:18:59.317100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:59.318557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:59.328180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 152/308] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:18:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:59.333880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:59.440850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab4a8a-2ae4-4f79-a952-251e82c02c71 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:59.475980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1654f-84fe-420e-ae7e-41a5172846e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:59.476669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1654f-84fe-420e-ae7e-41a5172846e2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:59.476951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1654f-84fe-420e-ae7e-41a5172846e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:59.477222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1654f-84fe-420e-ae7e-41a5172846e2 None admin] PATH_INFO: `/v3/users/ef43b670bdce47568beb25dc238f650b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:59.478406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1654f-84fe-420e-ae7e-41a5172846e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ef43b670bdce47568beb25dc238f650b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:59.479851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1654f-84fe-420e-ae7e-41a5172846e2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:59.481652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 157/309] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:18:59 2022] GET /identity/v3/users/ef43b670bdce47568beb25dc238f650b => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:18:59.487446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:59.506882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:59.599940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f747-b920-4164-9125-a3fcc5a02bcb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:59.635084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e01a8-d444-4fdb-b57a-d41928738be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:59.635742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e01a8-d444-4fdb-b57a-d41928738be2 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:59.636020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e01a8-d444-4fdb-b57a-d41928738be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:59.636338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e01a8-d444-4fdb-b57a-d41928738be2 None admin] PATH_INFO: `/v3/system/users/ef43b670bdce47568beb25dc238f650b/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:59.637999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e01a8-d444-4fdb-b57a-d41928738be2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef43b670bdce47568beb25dc238f650b, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:59.639396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e01a8-d444-4fdb-b57a-d41928738be2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:59.652417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 153/310] 10.222.0.25 () {58 vars in 1334 bytes} [Mon Aug 8 02:18:59 2022] PUT /identity/v3/system/users/ef43b670bdce47568beb25dc238f650b/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:18:59.819296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db77f4f-181a-4289-b574-b9db71635067 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:59.819639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db77f4f-181a-4289-b574-b9db71635067 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:59.819808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db77f4f-181a-4289-b574-b9db71635067 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:59.821254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 158/311] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:59.827378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ba2f-c18b-472d-93fe-c44eb3a408ef None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:59.827894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ba2f-c18b-472d-93fe-c44eb3a408ef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:59.828363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ba2f-c18b-472d-93fe-c44eb3a408ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:59.847319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-36b8ba2f-c18b-472d-93fe-c44eb3a408ef None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:59.848955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-36b8ba2f-c18b-472d-93fe-c44eb3a408ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:59.921017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 154/312] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:18:59.944638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db77f4f-181a-4289-b574-b9db71635067 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:59.977227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:00.053480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db77f4f-181a-4289-b574-b9db71635067 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:00.089059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:00.089852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.090156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.090429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.100974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:00.105843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:00.106729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:00.107731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 159/313] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:18:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:00.113269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ba2f-c18b-472d-93fe-c44eb3a408ef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:00.122585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:00.223241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ba2f-c18b-472d-93fe-c44eb3a408ef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:00.258847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:00.259857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.260328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.260758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.261806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:00.262393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:00.264065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:00.277445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 155/314] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:00.279850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:00.377281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:00.388842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c8500-e97e-4d35-90cc-781060e3efc7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:00.424046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:00.425031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.425535 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.426006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] PATH_INFO: `/v3/users/fa7ecf9353a240f6a2a0782949965fb7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.427366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] RBAC: Authorizing `identity:get_user(user_id=fa7ecf9353a240f6a2a0782949965fb7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:00.429038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:00.431605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 160/315] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:19:00 2022] GET /identity/v3/users/fa7ecf9353a240f6a2a0782949965fb7 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:00.437500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:00.507742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:00.545488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78b084-44ce-4e1f-bb39-8e6261a692e6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:00.581462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:00.582449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.582960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.583444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.657357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:00.658858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:00.733574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:00.769551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 156/316] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:00.775401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:00.881333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31389f-b346-4e40-b136-eef89196e3bb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:00.915333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b7c3-4911-495f-9849-a08b205984c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:00.915972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b7c3-4911-495f-9849-a08b205984c4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.916247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b7c3-4911-495f-9849-a08b205984c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.916515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b7c3-4911-495f-9849-a08b205984c4 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.917805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046b7c3-4911-495f-9849-a08b205984c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:00.919280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046b7c3-4911-495f-9849-a08b205984c4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:00.921223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 161/317] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:00 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:00.926873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:00.934860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54119dec-b9b9-4992-9c8e-2f03f7cd8e68 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.935141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54119dec-b9b9-4992-9c8e-2f03f7cd8e68 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.935412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54119dec-b9b9-4992-9c8e-2f03f7cd8e68 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.937494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 162/318] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:00.943596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50f34-7dfd-48e5-9c07-f6cc3c711184 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.944237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50f34-7dfd-48e5-9c07-f6cc3c711184 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.944522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50f34-7dfd-48e5-9c07-f6cc3c711184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.967059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-65c50f34-7dfd-48e5-9c07-f6cc3c711184 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:00.968325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-65c50f34-7dfd-48e5-9c07-f6cc3c711184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:00.998068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:01.035649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3562fdb-d1b1-4c4f-b131-ed579ab0aa84 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.058375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 163/319] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:01.074596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b86ef2-cd44-4fb5-914e-af6f6c644520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.075621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b86ef2-cd44-4fb5-914e-af6f6c644520 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.075904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b86ef2-cd44-4fb5-914e-af6f6c644520 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.076181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b86ef2-cd44-4fb5-914e-af6f6c644520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.076969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b86ef2-cd44-4fb5-914e-af6f6c644520 None admin] RBAC: Adding query filter params (role.id=dbab5115a54f48bca375041930970192, scope.project.id=1622a1b2569948e4a8c2c82f66024821, user.id=fa7ecf9353a240f6a2a0782949965fb7) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:01.077283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b86ef2-cd44-4fb5-914e-af6f6c644520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:01.078819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b86ef2-cd44-4fb5-914e-af6f6c644520 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:01.081014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50f34-7dfd-48e5-9c07-f6cc3c711184 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:01.085918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 157/320] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:00 2022] GET /identity/v3/role_assignments?user.id=fa7ecf9353a240f6a2a0782949965fb7&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=dbab5115a54f48bca375041930970192 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:01.115647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71f04-7e2e-4f9d-b077-500d4ac3da29 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.115947 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71f04-7e2e-4f9d-b077-500d4ac3da29 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.116204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71f04-7e2e-4f9d-b077-500d4ac3da29 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.117915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 158/321] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:01.123578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df046-a8c4-4bcf-9563-941c25457d6a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.123858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df046-a8c4-4bcf-9563-941c25457d6a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.124129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df046-a8c4-4bcf-9563-941c25457d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.145331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-415df046-a8c4-4bcf-9563-941c25457d6a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:01.146498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-415df046-a8c4-4bcf-9563-941c25457d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:01.184926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:01.202882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50f34-7dfd-48e5-9c07-f6cc3c711184 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.241909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.242935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.243382 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.243819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.245505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 159/322] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:01.250531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:01.252325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:01.254275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 164/323] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:01.261007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df046-a8c4-4bcf-9563-941c25457d6a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:01.267701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:01.297819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:01.388597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df046-a8c4-4bcf-9563-941c25457d6a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.399186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56407-8e1d-45bf-bff9-7d360acc5452 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.422885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.423601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.423878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.424145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] PATH_INFO: `/v3/groups` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.424771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:01.426277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:01.435045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.435957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.436236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.436575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.443689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 160/324] 10.222.0.25 () {60 vars in 1134 bytes} [Mon Aug 8 02:19:01 2022] POST /identity/v3/groups => generated 226 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:01.449661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:01.455476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:01.456480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:19:01.457234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:01.462259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 165/325] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:01.463889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:01.493043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:01.578762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3a16-83bf-450f-a918-532ff5e40ee0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.629055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898742a3-2b0f-49e5-832f-b1441aebf3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.629720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898742a3-2b0f-49e5-832f-b1441aebf3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.630001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898742a3-2b0f-49e5-832f-b1441aebf3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.630269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898742a3-2b0f-49e5-832f-b1441aebf3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.630947 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898742a3-2b0f-49e5-832f-b1441aebf3b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:01.631247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898742a3-2b0f-49e5-832f-b1441aebf3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:01.632649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898742a3-2b0f-49e5-832f-b1441aebf3b1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:01.642789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 161/326] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:01.649512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:01.683604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f854c-448e-4f44-9b74-f52afff853b4 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.684027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f854c-448e-4f44-9b74-f52afff853b4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.684161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f854c-448e-4f44-9b74-f52afff853b4 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.685934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 162/327] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:01.691214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901741-9c97-4e1d-8651-35ddb406c2d3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.691214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901741-9c97-4e1d-8651-35ddb406c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.691214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901741-9c97-4e1d-8651-35ddb406c2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.716736 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a2901741-9c97-4e1d-8651-35ddb406c2d3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:01.718035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a2901741-9c97-4e1d-8651-35ddb406c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:01.751243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:01.772135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726ee9-27de-42a5-a99e-66154c0e1bf8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.802827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 163/328] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 08 02:19:01.815561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.816183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.816459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.816726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] PATH_INFO: `/v3/users/9d3f9cef417342a4b93c716f6b18407d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.819691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3f9cef417342a4b93c716f6b18407d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:01.819691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:01.821270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 166/329] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:19:01 2022] GET /identity/v3/users/9d3f9cef417342a4b93c716f6b18407d => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:01.827675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2901741-9c97-4e1d-8651-35ddb406c2d3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:01.829073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:01.851312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:01.955544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb6aa7-35c8-4e79-8653-d31ddccfb8f7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.960982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2901741-9c97-4e1d-8651-35ddb406c2d3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.996746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.997729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.998269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.998680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.004246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:02.004932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:02.005210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:02.005509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] PATH_INFO: `/v3/system/users/9d3f9cef417342a4b93c716f6b18407d/roles/dbab5115a54f48bca375041930970192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.007123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d3f9cef417342a4b93c716f6b18407d, role_id=dbab5115a54f48bca375041930970192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:02.008533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:02.011791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:02.019132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:02.020035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:02.021228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 167/330] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:02.025209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 164/331] 10.222.0.25 () {58 vars in 1334 bytes} [Mon Aug 8 02:19:01 2022] PUT /identity/v3/system/users/9d3f9cef417342a4b93c716f6b18407d/roles/dbab5115a54f48bca375041930970192 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:19:02.028768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:02.048080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:02.153420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ca98-2ff0-4513-8a1e-aabab615dbd7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:02.191132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:02.191766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:02.192045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:02.192321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.192999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:02.193303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:02.194923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:02.205770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 168/332] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:02.211519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:02.299270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:02.326418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e133-8c55-4118-9375-e5182b88693b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:02.363093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addd32f-d424-49e3-8636-680795af7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:02.363734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addd32f-d424-49e3-8636-680795af7ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:02.364015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addd32f-d424-49e3-8636-680795af7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:02.364287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addd32f-d424-49e3-8636-680795af7ed0 None admin] PATH_INFO: `/v3/users/ef43b670bdce47568beb25dc238f650b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.365448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addd32f-d424-49e3-8636-680795af7ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=ef43b670bdce47568beb25dc238f650b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:02.366930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addd32f-d424-49e3-8636-680795af7ed0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:02.368758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 165/333] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:19:02 2022] GET /identity/v3/users/ef43b670bdce47568beb25dc238f650b => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:02.374434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:02.462651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:02.486860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89199e2-66b7-4c61-82b0-3563fbf73e77 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:02.522681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9569cf-4265-4054-adfd-d5f3c32a959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:02.523296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9569cf-4265-4054-adfd-d5f3c32a959f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:02.523575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9569cf-4265-4054-adfd-d5f3c32a959f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:02.523844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9569cf-4265-4054-adfd-d5f3c32a959f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.524567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9569cf-4265-4054-adfd-d5f3c32a959f None admin] RBAC: Adding query filter params (role.id=7322aadd09fa4f9fbb977a9ce8f9b768, user.id=ef43b670bdce47568beb25dc238f650b, scope.system=all) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:02.524871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9569cf-4265-4054-adfd-d5f3c32a959f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:02.526344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9569cf-4265-4054-adfd-d5f3c32a959f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:02.541164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 169/334] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Aug 8 02:19:02 2022] GET /identity/v3/role_assignments?user.id=ef43b670bdce47568beb25dc238f650b&scope.system=all&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:03.812741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ad183-8ddf-414f-9c40-a3d5a72f99cf None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:03.813771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ad183-8ddf-414f-9c40-a3d5a72f99cf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:03.814245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ad183-8ddf-414f-9c40-a3d5a72f99cf None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:03.816008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 166/335] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:03.821633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a38d-33ee-4042-8974-59d00e8c922d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:03.822050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a38d-33ee-4042-8974-59d00e8c922d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:03.822183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a38d-33ee-4042-8974-59d00e8c922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:03.858363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0093a38d-33ee-4042-8974-59d00e8c922d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:03.859940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0093a38d-33ee-4042-8974-59d00e8c922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:03.939102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 170/336] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:03.977798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ad183-8ddf-414f-9c40-a3d5a72f99cf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:04.103252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ad183-8ddf-414f-9c40-a3d5a72f99cf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:04.138921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:04.139927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.140372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.140877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.153385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:04.159018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:04.159860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:04.160624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:04.162555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 167/337] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:04.168936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a38d-33ee-4042-8974-59d00e8c922d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:04.238753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:04.283598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a38d-33ee-4042-8974-59d00e8c922d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:04.319720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7dde3-c669-4121-ae77-2b44573b9729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:04.320575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7dde3-c669-4121-ae77-2b44573b9729 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.320988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7dde3-c669-4121-ae77-2b44573b9729 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.321440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7dde3-c669-4121-ae77-2b44573b9729 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.322237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7dde3-c669-4121-ae77-2b44573b9729 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:04.322671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7dde3-c669-4121-ae77-2b44573b9729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:04.324748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7dde3-c669-4121-ae77-2b44573b9729 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:04.337485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 171/338] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:04.339658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:04.349754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:04.446157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaff8a-2c51-4943-b255-8633d12c7140 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:04.484296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e7c5f-0551-431d-b4db-12974ab0e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:04.484968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7c5f-0551-431d-b4db-12974ab0e316 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.485248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7c5f-0551-431d-b4db-12974ab0e316 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.485569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7c5f-0551-431d-b4db-12974ab0e316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.560452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e7c5f-0551-431d-b4db-12974ab0e316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:04.561885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e7c5f-0551-431d-b4db-12974ab0e316 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:04.570030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:04.635262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e073de-c0bc-40ab-9cf8-3b493c2dbad1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.635538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e073de-c0bc-40ab-9cf8-3b493c2dbad1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.638905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e073de-c0bc-40ab-9cf8-3b493c2dbad1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.638905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 172/339] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:04.644662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a154-9cfc-4331-b5a9-00385faccd3f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.644944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a154-9cfc-4331-b5a9-00385faccd3f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.645200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a154-9cfc-4331-b5a9-00385faccd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.680145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fca5a154-9cfc-4331-b5a9-00385faccd3f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:04.682595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fca5a154-9cfc-4331-b5a9-00385faccd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:04.783514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 168/340] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:04.784872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d17ff-c292-498b-9cb9-96bd6ac75bf1 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.785493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d17ff-c292-498b-9cb9-96bd6ac75bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.785778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d17ff-c292-498b-9cb9-96bd6ac75bf1 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.789317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 169/341] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:04.790096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d17ff-c292-498b-9cb9-96bd6ac75bf1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:04.845160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 173/342] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:04.846408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cab85-cf11-4007-9506-c5f208d7e750 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.846694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cab85-cf11-4007-9506-c5f208d7e750 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.849326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cab85-cf11-4007-9506-c5f208d7e750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.887730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-af1cab85-cf11-4007-9506-c5f208d7e750 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:04.889168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-af1cab85-cf11-4007-9506-c5f208d7e750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:04.999036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d17ff-c292-498b-9cb9-96bd6ac75bf1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:05.006742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:05.020600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:05.059954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 174/343] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:05.061503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cab85-cf11-4007-9506-c5f208d7e750 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:05.071040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:05.071933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.072336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.072727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.078059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:05.079693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:05.081615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 170/344] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:04 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:05.087213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:05.328849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a41b5-19cd-422b-80e9-3dd04d981082 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:05.342767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cab85-cf11-4007-9506-c5f208d7e750 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:05.383741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:05.384793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.385218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.385666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.392624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:05.394345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:05.396570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 171/345] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:05.397620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:05.411852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:05.412654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.413172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.413657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.438688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:05.442816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:05.449999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:05.451262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:05.452018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:05.455456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 175/346] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:05.456501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:05.514578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:05.518030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45b352-ff78-4355-8b87-1309ef4321dc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:05.557582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e76a88-a59b-41e0-9ab7-85fe740ae826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:05.558721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e76a88-a59b-41e0-9ab7-85fe740ae826 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.559203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e76a88-a59b-41e0-9ab7-85fe740ae826 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.559706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e76a88-a59b-41e0-9ab7-85fe740ae826 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.573929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e76a88-a59b-41e0-9ab7-85fe740ae826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f0e76a88-a59b-41e0-9ab7-85fe740ae826 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:05.579489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:05.580469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:19:05.581298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:05.583508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 172/347] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:05.583931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027da1c-9f39-40f7-9d34-0fb5b69f6f27 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:05.585031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd855-0638-4c32-a645-6d7e3ab9c55a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.587700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd855-0638-4c32-a645-6d7e3ab9c55a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.588253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd855-0638-4c32-a645-6d7e3ab9c55a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.589854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 173/348] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:05.590723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd855-0638-4c32-a645-6d7e3ab9c55a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:05.642244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9e5d2-d7f9-4252-9127-630e12822a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:05.643090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9e5d2-d7f9-4252-9127-630e12822a2d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.643536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9e5d2-d7f9-4252-9127-630e12822a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.643912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9e5d2-d7f9-4252-9127-630e12822a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.644779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9e5d2-d7f9-4252-9127-630e12822a2d None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=14a696a642e44af38cba2ff089f73072) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:05.645091 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9e5d2-d7f9-4252-9127-630e12822a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:05.646856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9e5d2-d7f9-4252-9127-630e12822a2d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:05.654706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 176/349] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:05.655981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb98d-0d5d-4b89-bdc1-dadf9fdd9f11 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.656721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb98d-0d5d-4b89-bdc1-dadf9fdd9f11 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.657003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb98d-0d5d-4b89-bdc1-dadf9fdd9f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.684041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-37feb98d-0d5d-4b89-bdc1-dadf9fdd9f11 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:05.685255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-37feb98d-0d5d-4b89-bdc1-dadf9fdd9f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:05.742001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:05.750020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd855-0638-4c32-a645-6d7e3ab9c55a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:05.773619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 177/350] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:05.774523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feb98d-0d5d-4b89-bdc1-dadf9fdd9f11 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:05.801521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:05.802756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.803058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.803383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.804373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:05.804682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:05.806918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:05.819013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 174/351] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:05.823289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:05.824161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:05.938636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feb98d-0d5d-4b89-bdc1-dadf9fdd9f11 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:05.976165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:05.977149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:05.977684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:05.978143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:05.978992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:05.979476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:05.981291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:05.990450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 178/352] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:05.991723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.013178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982626-1664-4f32-ad6e-9faf3594eced None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.056347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.056551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.056816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.057094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.071047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:06.077912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:06.078794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 175/353] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:06.080944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.108199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.116797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6a98-3f5d-4f75-98aa-9a490a136b35 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.118778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.184710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccdec9-2a9d-4786-a218-b531a21cd344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.185830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccdec9-2a9d-4786-a218-b531a21cd344 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.186299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccdec9-2a9d-4786-a218-b531a21cd344 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.186756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccdec9-2a9d-4786-a218-b531a21cd344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.208178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb66f5-516c-4b9f-8603-d2028f6d982e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.247316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.249330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.249831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.250308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] PATH_INFO: `/v3/users/9d3f9cef417342a4b93c716f6b18407d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.251671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] RBAC: Authorizing `identity:get_user(user_id=9d3f9cef417342a4b93c716f6b18407d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:06.253405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:06.255928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 176/354] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/users/9d3f9cef417342a4b93c716f6b18407d => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:06.257104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.292903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccdec9-2a9d-4786-a218-b531a21cd344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:06.294448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccdec9-2a9d-4786-a218-b531a21cd344 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:06.368600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.384429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75ae96-b95b-4842-8be4-2847c654325c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.416494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 179/355] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:06.419594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721395-f500-41fd-bec9-cac648cd68be None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.419958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721395-f500-41fd-bec9-cac648cd68be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.420306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721395-f500-41fd-bec9-cac648cd68be None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.422680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 180/356] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:06.423402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721395-f500-41fd-bec9-cac648cd68be None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.431707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.436103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef78420-e9eb-4dd7-93ad-2ee49d17f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.436103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef78420-e9eb-4dd7-93ad-2ee49d17f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.436103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef78420-e9eb-4dd7-93ad-2ee49d17f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.436103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef78420-e9eb-4dd7-93ad-2ee49d17f1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.436440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef78420-e9eb-4dd7-93ad-2ee49d17f1c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:06.436440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef78420-e9eb-4dd7-93ad-2ee49d17f1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:06.437298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef78420-e9eb-4dd7-93ad-2ee49d17f1c1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:06.451760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 177/357] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:06.453787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b41f8-732f-4cd6-8d28-7474a33ea625 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.454078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b41f8-732f-4cd6-8d28-7474a33ea625 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.454387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b41f8-732f-4cd6-8d28-7474a33ea625 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.456338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 178/358] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:06.457560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b41f8-732f-4cd6-8d28-7474a33ea625 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.550549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721395-f500-41fd-bec9-cac648cd68be None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.594756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b41f8-732f-4cd6-8d28-7474a33ea625 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.596138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83e0b-8c10-449b-8e35-3cefa9a1d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.596764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83e0b-8c10-449b-8e35-3cefa9a1d25d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.597044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83e0b-8c10-449b-8e35-3cefa9a1d25d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.597322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83e0b-8c10-449b-8e35-3cefa9a1d25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.598088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83e0b-8c10-449b-8e35-3cefa9a1d25d None admin] RBAC: Adding query filter params (role.id=dbab5115a54f48bca375041930970192, user.id=9d3f9cef417342a4b93c716f6b18407d, scope.system=all) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:06.598403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83e0b-8c10-449b-8e35-3cefa9a1d25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:06.599875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83e0b-8c10-449b-8e35-3cefa9a1d25d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:06.615579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 181/359] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/role_assignments?user.id=9d3f9cef417342a4b93c716f6b18407d&scope.system=all&role.id=dbab5115a54f48bca375041930970192 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:06.617221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21889adf-8100-4e70-8990-8e3a5ee36a65 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.617715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21889adf-8100-4e70-8990-8e3a5ee36a65 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.618150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21889adf-8100-4e70-8990-8e3a5ee36a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.647353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-21889adf-8100-4e70-8990-8e3a5ee36a65 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:06.648712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21889adf-8100-4e70-8990-8e3a5ee36a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:06.649319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e0212-8016-499c-a1fb-d286c9675793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.650087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e0212-8016-499c-a1fb-d286c9675793 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.650462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e0212-8016-499c-a1fb-d286c9675793 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.650811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e0212-8016-499c-a1fb-d286c9675793 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.653855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e0212-8016-499c-a1fb-d286c9675793 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:06.655359 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e0212-8016-499c-a1fb-d286c9675793 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:06.657407 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 179/360] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:06.661426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6163-08b8-4002-a44b-01d61bb080e8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.661426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6163-08b8-4002-a44b-01d61bb080e8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.661426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a6163-08b8-4002-a44b-01d61bb080e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.690325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8a0a6163-08b8-4002-a44b-01d61bb080e8 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:06.692428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8a0a6163-08b8-4002-a44b-01d61bb080e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:06.713789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.740378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.754378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 182/361] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:06.759946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21889adf-8100-4e70-8990-8e3a5ee36a65 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.792986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 180/362] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:06.794547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6163-08b8-4002-a44b-01d61bb080e8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.901131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21889adf-8100-4e70-8990-8e3a5ee36a65 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.937872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a6163-08b8-4002-a44b-01d61bb080e8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.946465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.947101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.947404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.947673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.991359 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.992379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.992846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.993303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.994796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:06.996312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:06.999405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 181/363] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:06.999405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.020302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.020901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.036826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:07.038770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:07.130453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2492cfd-2b74-40cd-98ef-fb6ebeaab00d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.169456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.170027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.170305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.170576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.184832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:07.188000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 183/364] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:07.189058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:07.193297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:07.194267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:07.195064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 182/365] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:07.195709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.300553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.313411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.328780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccf52c-fae4-41aa-9eae-d20b83c182a3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.328980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4092d69-bf8c-400a-99c4-a3289eb62a4d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.372322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.372939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.374855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.374855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.375041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=14a696a642e44af38cba2ff089f73072) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:07.375287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:07.377472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:07.378253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.379066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.379491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.379910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.383220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 183/366] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=d138e21392054605846b1a7ee19e3814 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:07.384059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.405040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:07.413550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:07.414523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:07.415320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:07.418903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 184/367] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:07.420497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.503440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbc4c-2145-4a82-b8c7-5a6a6316dc72 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.540979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336f44-74b2-425a-81bd-692379d1ad9d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.544257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.545717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.546010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.546290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.550162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:07.553791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:07.556561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 184/368] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:07.558310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.577912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.592171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.592838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.593119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.593448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.594136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:07.594737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:07.596072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:07.607411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 185/369] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:07.613291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.639050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.700015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c09655-6972-48e7-b952-9aee1c8b68af None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.742293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.742293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.742293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.742293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.742754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:07.742754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:07.742754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:07.750293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 185/370] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:07.751451 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.766946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dcdc7-106f-4044-8910-fef3c5db7cbb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.813396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.814153 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.814450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.814732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.815880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:07.817461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:07.819780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 186/371] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:07.820580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:07.882148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.892450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09ab9-d1b8-4aea-8edc-1b2e2f5c1245 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.927939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:07.941647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.942850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.943326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.943901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:07.951252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84166bd-d5fa-45db-a497-8c915eb51ea7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:07.994925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23f2de-402c-4580-b4d2-81211032a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:07.996207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f2de-402c-4580-b4d2-81211032a801 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:07.996506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f2de-402c-4580-b4d2-81211032a801 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:07.996782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f2de-402c-4580-b4d2-81211032a801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.039617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.041275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.079380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23f2de-402c-4580-b4d2-81211032a801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.080879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23f2de-402c-4580-b4d2-81211032a801 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.128549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:08.167940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 186/372] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:08.169007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.191489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:08.224795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 187/373] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:08.231207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43bf48-6ad1-4f56-9bee-19680246a34a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.231513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43bf48-6ad1-4f56-9bee-19680246a34a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.231762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43bf48-6ad1-4f56-9bee-19680246a34a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.233085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 188/374] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:08.234843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43bf48-6ad1-4f56-9bee-19680246a34a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.298544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96b86b-26f1-4e46-9485-08b0147db1e5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:08.339354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:08.340151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.340433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.340710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.341508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=1622a1b2569948e4a8c2c82f66024821) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:08.341813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.343276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.350426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 187/375] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:08.351031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.357904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43bf48-6ad1-4f56-9bee-19680246a34a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:08.403608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:08.406897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88038197-4795-46a8-90cf-12a246008140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:08.407769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038197-4795-46a8-90cf-12a246008140 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.408146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038197-4795-46a8-90cf-12a246008140 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.408624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038197-4795-46a8-90cf-12a246008140 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.410811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88038197-4795-46a8-90cf-12a246008140 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.412795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88038197-4795-46a8-90cf-12a246008140 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.415150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 189/376] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:08.416460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d11bc-0556-4cc5-a81d-c24922dccecf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.422066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d11bc-0556-4cc5-a81d-c24922dccecf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.422403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d11bc-0556-4cc5-a81d-c24922dccecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.443579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-232d11bc-0556-4cc5-a81d-c24922dccecf None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:08.445080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-232d11bc-0556-4cc5-a81d-c24922dccecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:08.498351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a689e-9fc1-4179-ae1f-1a77803f35e1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:08.503300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:08.541543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 190/377] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:08.542891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d11bc-0556-4cc5-a81d-c24922dccecf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.555111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:08.556070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.556548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.557054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] PATH_INFO: `/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.558495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] RBAC: Authorizing `identity:get_project(project_id=a6ce53165eb847a3be1e8ef59c28b2a1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.560204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.562105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 188/378] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:08.566360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.673244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d11bc-0556-4cc5-a81d-c24922dccecf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:08.714957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62edbb6-de65-4036-afaa-6ded536245b2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:08.716733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:08.726195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:08.728846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.728846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.728846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.729330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.730922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.732734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 191/379] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:08.737579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.774595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:08.775893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.776521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.777435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.791430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:08.797766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:08.798823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:08.799719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:08.800485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:08.803212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 189/380] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:08.804324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.863015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d9823-d384-49ae-99a0-12089cd9830e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:08.910440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:08.911496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.912336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.912835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] PATH_INFO: `/v3/groups/fc871815fe85462295dab868a04a0558` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.922538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] RBAC: Authorizing `identity:get_group(group_id=fc871815fe85462295dab868a04a0558)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.925059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.927929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 192/381] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/groups/fc871815fe85462295dab868a04a0558 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:08.929009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:08.936902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9908b-83fc-4d45-8e72-c6f89dbad772 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:08.973903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:08.974513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.974789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.975057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.975878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=1622a1b2569948e4a8c2c82f66024821) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:08.976187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:08.977778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:08.984498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 190/382] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=d138e21392054605846b1a7ee19e3814 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:08.985395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:09.020917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:09.068874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf16e-aeaa-4752-9bca-0de24863a17d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:09.092499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:09.125822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:09.126493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.126772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.127037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.127713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:09.128486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:09.130086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:09.141823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 193/383] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:09.147897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:09.159771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614beca-e6c1-4c42-bccd-2811dff898b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:09.247130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:09.247766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.248049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.248328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.249073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] RBAC: Adding query filter params (group.id=fc871815fe85462295dab868a04a0558, role.id=1470302d39e340299072b424021b764b, scope.project.id=a6ce53165eb847a3be1e8ef59c28b2a1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:09.250705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:09.250942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:09.258605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 191/384] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:08 2022] GET /identity/v3/role_assignments?group.id=fc871815fe85462295dab868a04a0558&scope.project.id=a6ce53165eb847a3be1e8ef59c28b2a1&role.id=1470302d39e340299072b424021b764b => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:09.280252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4561afb-825f-4cfb-9910-cd4db453dd03 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:09.320238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:09.321084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.321394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.321658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.322980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:09.324951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:09.329724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 194/385] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:09 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:09.333452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:09.469198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:09.483487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd173a77-71e5-4aea-b7ac-4333d0856be0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:09.527539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4af30d-d676-4c03-9b28-af12bcbf7791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:09.528110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af30d-d676-4c03-9b28-af12bcbf7791 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.528387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af30d-d676-4c03-9b28-af12bcbf7791 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.528657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af30d-d676-4c03-9b28-af12bcbf7791 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.529818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4af30d-d676-4c03-9b28-af12bcbf7791 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:09.531277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4af30d-d676-4c03-9b28-af12bcbf7791 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:09.533279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 192/386] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:09 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:09.539055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:09.608149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:09.690177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af58a-6aab-407c-93d0-b78e7a2fa6c0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:09.728589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0ba7b-3a09-47a4-b8f4-4ccfa9f74a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:09.729270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ba7b-3a09-47a4-b8f4-4ccfa9f74a1e None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.729640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ba7b-3a09-47a4-b8f4-4ccfa9f74a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.729946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ba7b-3a09-47a4-b8f4-4ccfa9f74a1e None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.732307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0ba7b-3a09-47a4-b8f4-4ccfa9f74a1e None admin] RBAC: Authorizing `identity:create_grant(project_id=14a696a642e44af38cba2ff089f73072, group_id=34f0bfb0eab4400ba5ba022aa7abb0ce, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:09.733867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0ba7b-3a09-47a4-b8f4-4ccfa9f74a1e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:09.757614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 195/387] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Aug 8 02:19:09 2022] PUT /identity/v3/projects/14a696a642e44af38cba2ff089f73072/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:09.861770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924f746-8989-4353-84c1-37703b5073de None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.862394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924f746-8989-4353-84c1-37703b5073de None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.862889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924f746-8989-4353-84c1-37703b5073de None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.864869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 193/388] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:09.872261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0b4b-99fd-4135-a22b-d900873584d9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.872894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0b4b-99fd-4135-a22b-d900873584d9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.873409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0b4b-99fd-4135-a22b-d900873584d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.893099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-571b0b4b-99fd-4135-a22b-d900873584d9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:09.894761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-571b0b4b-99fd-4135-a22b-d900873584d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:09.974791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 196/389] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:10.000075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924f746-8989-4353-84c1-37703b5073de None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:10.120959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924f746-8989-4353-84c1-37703b5073de None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:10.158103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:10.159167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:10.159693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:10.160173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:10.172955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:10.178152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:10.179069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:10.179996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:10.182713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 194/390] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:10.189038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0b4b-99fd-4135-a22b-d900873584d9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:10.225297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:10.321881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0b4b-99fd-4135-a22b-d900873584d9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:10.375941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:10.376940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:10.377446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:10.377931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:10.378846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:10.379361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:10.380934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:10.393006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 197/391] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:10.398874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:10.420039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:10.516425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7880d2-1a47-46d4-8ffc-2eb7a7f33dcd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:10.551605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:10.552641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:10.553139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:10.553641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:10.554988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:10.556769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:10.559001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 195/392] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:10 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:10.564764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:10.679208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:10.690311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59262-def8-44ce-a6f2-bbe67edfa0af None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:10.728523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00938f8e-de34-450c-9502-1b1d80d3ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:10.729734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938f8e-de34-450c-9502-1b1d80d3ca59 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:10.730230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938f8e-de34-450c-9502-1b1d80d3ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:10.730708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938f8e-de34-450c-9502-1b1d80d3ca59 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:10.732076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00938f8e-de34-450c-9502-1b1d80d3ca59 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:10.733792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00938f8e-de34-450c-9502-1b1d80d3ca59 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:10.736022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 198/393] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:10 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:10.742173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:10.801281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993fc2d-73cb-4235-ba5b-f0039e789c28 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:10.801686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993fc2d-73cb-4235-ba5b-f0039e789c28 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:10.801863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993fc2d-73cb-4235-ba5b-f0039e789c28 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:10.803339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 199/394] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:10.808140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d984e0-3b17-4d93-9166-ae3ff593b002 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:10.808480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d984e0-3b17-4d93-9166-ae3ff593b002 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:10.808758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d984e0-3b17-4d93-9166-ae3ff593b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:10.848854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c7d984e0-3b17-4d93-9166-ae3ff593b002 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:10.850086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7d984e0-3b17-4d93-9166-ae3ff593b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:10.871659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:10.895725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f137f3-6544-48a8-88e4-3adac92f68e4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:10.953717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:10.954852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:10.955376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:10.955861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:10.961641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 200/395] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:10.962502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] RBAC: Authorizing `identity:create_grant(project_id=14a696a642e44af38cba2ff089f73072, group_id=34f0bfb0eab4400ba5ba022aa7abb0ce, role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:10.964111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:10.983236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d984e0-3b17-4d93-9166-ae3ff593b002 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:10.997395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 196/396] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Aug 8 02:19:10 2022] PUT /identity/v3/projects/14a696a642e44af38cba2ff089f73072/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/d138e21392054605846b1a7ee19e3814 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:11.133791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:11.147680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d984e0-3b17-4d93-9166-ae3ff593b002 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:11.188980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:11.189656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.190201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.190201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.201590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:11.206830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:11.207675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:11.208460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 201/397] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:11.215733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:11.337638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97b98-e650-4ea6-982c-3e06d1bc9308 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:11.388432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:11.389062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.389341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.389639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.390318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:11.390624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:11.392022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:11.400578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 197/398] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:11.406985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:11.515934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582c7e-4936-42b7-8597-07a47cbe5aa4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:11.555064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:11.555710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.555995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.556258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.557388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:11.559551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:11.561528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 202/399] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:11 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:11.570550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:11.585723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:11.709593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401d2d-57e4-4112-baeb-2dd14eabf4a3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:11.744112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8246b-8f0f-4c50-945c-122156d68335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:11.744752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8246b-8f0f-4c50-945c-122156d68335 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.745034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8246b-8f0f-4c50-945c-122156d68335 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.745338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8246b-8f0f-4c50-945c-122156d68335 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.746508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8246b-8f0f-4c50-945c-122156d68335 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:11.747982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8246b-8f0f-4c50-945c-122156d68335 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:11.750144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 198/400] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:11 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:11.758435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:11.787825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:11.824251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ef38-c18c-4290-a1a6-217d6b1ecbfc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.824580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ef38-c18c-4290-a1a6-217d6b1ecbfc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.824804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ef38-c18c-4290-a1a6-217d6b1ecbfc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.826750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 199/401] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:11.830545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b350e-7280-4be8-91ac-5b557ec8cc07 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.830827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b350e-7280-4be8-91ac-5b557ec8cc07 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.831102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b350e-7280-4be8-91ac-5b557ec8cc07 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.832549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 200/402] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:11.837064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a196b3-b507-4fd8-a2de-1583f73bdeba None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.837347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a196b3-b507-4fd8-a2de-1583f73bdeba None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.837658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a196b3-b507-4fd8-a2de-1583f73bdeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.859842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-68a196b3-b507-4fd8-a2de-1583f73bdeba None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:11.861133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-68a196b3-b507-4fd8-a2de-1583f73bdeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:11.887732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4895b-b502-4f1c-a7d6-ea5dfef6c8fc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:11.925694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:11.926729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.927203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.927660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.929784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=1622a1b2569948e4a8c2c82f66024821, group_id=34f0bfb0eab4400ba5ba022aa7abb0ce, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:11.931541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:11.949154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 203/403] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Aug 8 02:19:11 2022] PUT /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:11.955600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 201/404] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:11.955600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db8c1-c98d-4ef4-8a04-ae5d9539782e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:11.955600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db8c1-c98d-4ef4-8a04-ae5d9539782e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:11.955600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db8c1-c98d-4ef4-8a04-ae5d9539782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:11.975903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:11.983251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:11.984071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d61db8c1-c98d-4ef4-8a04-ae5d9539782e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:11.985590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d61db8c1-c98d-4ef4-8a04-ae5d9539782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:12.113343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 202/405] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:12.151403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.167298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db8c1-c98d-4ef4-8a04-ae5d9539782e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.181500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dbe32-6212-48ea-a6c6-4802f3a38fcc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.216720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.218219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.218686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.219160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.231056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:12.236124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:12.237051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:12.237838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:12.240107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 204/406] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:12.246619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.280066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db8c1-c98d-4ef4-8a04-ae5d9539782e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.318520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.319163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.319444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.319717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.322773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.332590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:12.337933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:12.338799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:12.339701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:12.343559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 203/407] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:12.346119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.392495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db99d9-e023-40f6-81ec-a15b2edba3cf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.458762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95c0e7-285a-4878-a433-b76a20c7e846 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.496015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.497059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.498713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.500004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.500920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:12.502904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:12.504587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:12.518537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.523630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4237df-a418-4c25-996c-99805ff083e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.526749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4237df-a418-4c25-996c-99805ff083e1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.527294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4237df-a418-4c25-996c-99805ff083e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.527758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4237df-a418-4c25-996c-99805ff083e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.528418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 205/408] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:12.529428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4237df-a418-4c25-996c-99805ff083e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:12.530005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4237df-a418-4c25-996c-99805ff083e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:12.531599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4237df-a418-4c25-996c-99805ff083e1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:12.534056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.555684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 204/409] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:12.555684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb050625-67b4-4df7-a8b4-933bb9364e12 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.555684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb050625-67b4-4df7-a8b4-933bb9364e12 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.555684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb050625-67b4-4df7-a8b4-933bb9364e12 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.555684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 205/410] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:12.560959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51917f5b-5938-459b-adbe-59a012c78f9d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.561245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51917f5b-5938-459b-adbe-59a012c78f9d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.561566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51917f5b-5938-459b-adbe-59a012c78f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.582154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-51917f5b-5938-459b-adbe-59a012c78f9d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:12.583506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-51917f5b-5938-459b-adbe-59a012c78f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:12.652274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.653050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d632b-c5d8-40b7-811b-7013f52ce35f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.677875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 206/411] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:12.679155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51917f5b-5938-459b-adbe-59a012c78f9d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.687337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.688082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.688426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.688768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.693385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:12.693385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:12.693385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 206/412] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:12.698295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.766909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.801492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc325be-873f-46f2-9a9b-ea9232854cca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.807085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51917f5b-5938-459b-adbe-59a012c78f9d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.836464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.837305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.837458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.837670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.838785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:12.840444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:12.842472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 207/413] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:12.843492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.846767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.847841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.848319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.848793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] PATH_INFO: `/v3/groups/fc871815fe85462295dab868a04a0558` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.850227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] RBAC: Authorizing `identity:get_group(group_id=fc871815fe85462295dab868a04a0558)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:12.851894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:12.858827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 207/414] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/groups/fc871815fe85462295dab868a04a0558 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:12.860255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.922234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.946415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe3975-ff7f-41ce-aac4-d1e3504df8e1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.971914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eaa10-59a6-4a6f-8dfd-8c6316f2aed9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.981050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.981776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.982067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.982339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.984999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.993583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:12.998786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:12.999735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:13.000548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:13.008704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 208/415] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:13.008704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:13.023811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:13.024911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.025422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.025966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.028675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] RBAC: Authorizing `identity:create_grant(project_id=1622a1b2569948e4a8c2c82f66024821, group_id=34f0bfb0eab4400ba5ba022aa7abb0ce, role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:13.030448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:13.048432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 208/416] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Aug 8 02:19:12 2022] PUT /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821/groups/34f0bfb0eab4400ba5ba022aa7abb0ce/roles/d138e21392054605846b1a7ee19e3814 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:13.049678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:13.175219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7506-7f79-4e97-8c20-19d46882cf7e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:13.179643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc56a-6bf9-42b8-a849-da68549ae381 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:13.195307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:13.222625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:13.223620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.224098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.224593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.225532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:13.226196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:13.228803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:13.249565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 209/417] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:13.252610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:13.253740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:13.254437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.254719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.255038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] PATH_INFO: `/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.256866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] RBAC: Authorizing `identity:get_project(project_id=a6ce53165eb847a3be1e8ef59c28b2a1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:13.259512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:13.261816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 209/418] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:13 2022] GET /identity/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1 => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:13.268858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:13.372729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:13.377777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a3634-e2b7-4bdd-8b5c-8302bc8b4fcb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:13.422462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:13.423293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.423848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.424229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.445314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45046c3-f7e0-43cf-9a0c-944c6e29ec55 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:13.517686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede891-63e1-41a5-bd03-53eecad5a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:13.519637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede891-63e1-41a5-bd03-53eecad5a24b None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.521269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede891-63e1-41a5-bd03-53eecad5a24b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.521979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede891-63e1-41a5-bd03-53eecad5a24b None admin] PATH_INFO: `/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1/groups/fc871815fe85462295dab868a04a0558/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.525347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ede891-63e1-41a5-bd03-53eecad5a24b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6ce53165eb847a3be1e8ef59c28b2a1, group_id=fc871815fe85462295dab868a04a0558, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:13.527622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:13.531021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ede891-63e1-41a5-bd03-53eecad5a24b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:13.559343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 210/419] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Aug 8 02:19:13 2022] PUT /identity/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1/groups/fc871815fe85462295dab868a04a0558/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:13.574555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:13.577248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:13.605297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f086-f99b-4e59-a9a3-c9f0e04632d7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.605847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f086-f99b-4e59-a9a3-c9f0e04632d7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.606271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f086-f99b-4e59-a9a3-c9f0e04632d7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.608130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 211/420] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:13.618938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2a84-c57f-4858-85d5-66dd06ca489b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.619550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2a84-c57f-4858-85d5-66dd06ca489b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.625425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2a84-c57f-4858-85d5-66dd06ca489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.670744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-21cc2a84-c57f-4858-85d5-66dd06ca489b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:13.672475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21cc2a84-c57f-4858-85d5-66dd06ca489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:13.700466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 210/421] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:19:13.702446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:13.789481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 212/422] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:13.806705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2a84-c57f-4858-85d5-66dd06ca489b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:13.807563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:13.832112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227578-c1d8-40b1-924a-180b70760f26 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:13.864832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:13.874912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:13.875552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.875830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.877106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:13.882345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:13.884491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:13.886873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 211/423] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:13 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:13.898552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:13.926851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2a84-c57f-4858-85d5-66dd06ca489b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:13.996374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685683da-bfbf-424b-8417-bba111659eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:13.996985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685683da-bfbf-424b-8417-bba111659eec None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:13.997262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685683da-bfbf-424b-8417-bba111659eec None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:13.997555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685683da-bfbf-424b-8417-bba111659eec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.016197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685683da-bfbf-424b-8417-bba111659eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-685683da-bfbf-424b-8417-bba111659eec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:14.025186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:14.026083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:14.026945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 213/424] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:14.033197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685683da-bfbf-424b-8417-bba111659eec None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:14.111496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033d98-340a-4063-a1c3-7e007ceabad8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:14.156235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685683da-bfbf-424b-8417-bba111659eec None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:14.171878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:14.197326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:14.197738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:14.198014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.198323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.198601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.198829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.199164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.199437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.199737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:14.200509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:14.200815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:14.202203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:14.205620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:14.210400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 212/425] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:13 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:14.215147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:14.215779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 214/426] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:14.221443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:14.244898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:14.339287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5c33-5545-4cc7-afe5-6f094a77f9f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:14.377451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:14.378080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.378628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.378912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.413108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f578cb-b40c-43ea-be8b-1945d08bc57b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:14.433560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:14.468204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe9de1-b82c-4041-b1a9-e6347153f25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:14.468204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe9de1-b82c-4041-b1a9-e6347153f25f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.468483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:14.468591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe9de1-b82c-4041-b1a9-e6347153f25f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.468591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe9de1-b82c-4041-b1a9-e6347153f25f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.468591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe9de1-b82c-4041-b1a9-e6347153f25f None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=14a696a642e44af38cba2ff089f73072) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:14.468591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe9de1-b82c-4041-b1a9-e6347153f25f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:14.468841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:14.468916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe9de1-b82c-4041-b1a9-e6347153f25f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:14.474282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 213/427] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:14 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:14.475458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1fa64-94c7-4b31-b4ff-db2210554457 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.475747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1fa64-94c7-4b31-b4ff-db2210554457 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.476025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1fa64-94c7-4b31-b4ff-db2210554457 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.477548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 214/428] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:14.483616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddad48-f509-4ed8-8da5-b67ccd508260 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.484246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddad48-f509-4ed8-8da5-b67ccd508260 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.484733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddad48-f509-4ed8-8da5-b67ccd508260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.515839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-00ddad48-f509-4ed8-8da5-b67ccd508260 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:14.517651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-00ddad48-f509-4ed8-8da5-b67ccd508260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:14.669408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 215/429] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:14.671628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 215/430] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:14.676999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddad48-f509-4ed8-8da5-b67ccd508260 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:14.691756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:14.693707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:14.796808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:14.806008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddad48-f509-4ed8-8da5-b67ccd508260 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:14.826889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4cdf-9715-44bc-a15c-00243676ebbd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:14.844264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:14.845332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.845849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.846345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] PATH_INFO: `/v3/projects/14a696a642e44af38cba2ff089f73072` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.847760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] RBAC: Authorizing `identity:get_project(project_id=14a696a642e44af38cba2ff089f73072)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:14.849513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:14.851898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 216/431] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:14 2022] GET /identity/v3/projects/14a696a642e44af38cba2ff089f73072 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:14.857261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:14.877017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:14.877017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:14.877017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:14.877017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:14.889580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:14.895490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:14.896370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:19:14.897130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:14.899533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 216/432] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:14.910542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:14.960776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:14.992354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660562-89bc-4587-8a15-5e67406b9c0e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.033526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcfbe6-a983-41b0-b90a-aaa523f62e73 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.037470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.038361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.038860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.039333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.040681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.043022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.045617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 217/433] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:14 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:15.051370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.085179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.086763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.087889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.088430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.089582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:15.090537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.092828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.096725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.106891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 217/434] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:19:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:15.114387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.175478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0e8cf-7929-436a-af7c-0a028cc2f4bd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.219759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789969e-20f9-4bca-b0d8-0e8e96619e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.220978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789969e-20f9-4bca-b0d8-0e8e96619e92 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.221487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789969e-20f9-4bca-b0d8-0e8e96619e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.222062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789969e-20f9-4bca-b0d8-0e8e96619e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.222370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e20aa0-a9b4-42de-8697-30677b4bfbb8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.223220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789969e-20f9-4bca-b0d8-0e8e96619e92 None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=14a696a642e44af38cba2ff089f73072) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:15.223751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789969e-20f9-4bca-b0d8-0e8e96619e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.226243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789969e-20f9-4bca-b0d8-0e8e96619e92 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.232876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 218/435] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=14a696a642e44af38cba2ff089f73072&role.id=d138e21392054605846b1a7ee19e3814 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:15.266073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.267113 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.267634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.268209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.271260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662bb9-4a45-4439-9f46-b3e939b3d5f6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.271551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662bb9-4a45-4439-9f46-b3e939b3d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.271810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662bb9-4a45-4439-9f46-b3e939b3d5f6 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.274261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 219/436] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:15.283437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef4899-714d-4d15-a9ec-d47a7ec74002 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.284775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef4899-714d-4d15-a9ec-d47a7ec74002 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.285262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef4899-714d-4d15-a9ec-d47a7ec74002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.312086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-22ef4899-714d-4d15-a9ec-d47a7ec74002 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:15.314856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-22ef4899-714d-4d15-a9ec-d47a7ec74002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:15.317551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.358876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.367917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.369571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.404292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 220/437] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:15.435322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef4899-714d-4d15-a9ec-d47a7ec74002 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.506221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 218/438] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:15.513102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.571755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef4899-714d-4d15-a9ec-d47a7ec74002 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.610701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.611345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.611625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.611894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.623456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.634108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:15.639740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:15.640626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:15.641447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:15.642050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 221/439] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:15.647069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.650863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.656261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81095025-8fac-4cf0-98a4-ae1188d41a80 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.705515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.706234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.706234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.706641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.708230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.710119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.712029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 219/440] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:15.717551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.777662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46abb3-78db-4524-8d10-b2b468cecf64 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.818939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.819567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.819850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.820128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.820806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:15.821117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.822551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.829314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d4043-2aa1-415c-a93c-96ffc9a656e9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.831425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 222/441] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:15.836922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.864279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.864913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.865195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.865546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.866628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.868087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.869873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 220/442] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:15.875509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.899785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.911228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.941797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04780476-2458-46aa-b39d-ce3fcd0b6c06 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.974675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.975207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.975483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.975596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610f93-faad-4bf1-938a-621a97ae447f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.975753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.010622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a659e-47f9-4f4a-8f3d-441c70249c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.011276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a659e-47f9-4f4a-8f3d-441c70249c2e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.011555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a659e-47f9-4f4a-8f3d-441c70249c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.011827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a659e-47f9-4f4a-8f3d-441c70249c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.012548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a659e-47f9-4f4a-8f3d-441c70249c2e None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=7322aadd09fa4f9fbb977a9ce8f9b768, scope.project.id=1622a1b2569948e4a8c2c82f66024821) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:16.012856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a659e-47f9-4f4a-8f3d-441c70249c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.014336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a659e-47f9-4f4a-8f3d-441c70249c2e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.020180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 221/443] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=7322aadd09fa4f9fbb977a9ce8f9b768 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:16.021564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd34c1-3683-46f7-a7fb-1dbbd329d224 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.021847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd34c1-3683-46f7-a7fb-1dbbd329d224 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.022120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd34c1-3683-46f7-a7fb-1dbbd329d224 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.023369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 222/444] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:16.029235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7dbce-9908-475b-a59e-4aeb3fd5d2b6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.029594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7dbce-9908-475b-a59e-4aeb3fd5d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.029926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7dbce-9908-475b-a59e-4aeb3fd5d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.051796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1aa7dbce-9908-475b-a59e-4aeb3fd5d2b6 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:16.053216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1aa7dbce-9908-475b-a59e-4aeb3fd5d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:16.056161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.057756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.123643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:16.136403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 223/445] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:16.159877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7dbce-9908-475b-a59e-4aeb3fd5d2b6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:16.173699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 223/446] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:19:16.179696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:16.194560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:16.285179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7dbce-9908-475b-a59e-4aeb3fd5d2b6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:16.297752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be6ec-ae3f-40ba-a544-e068327f5c40 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:16.323790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.324437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.324718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.325332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.337443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:16.338332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.339553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.339553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.339907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] PATH_INFO: `/v3/projects/1622a1b2569948e4a8c2c82f66024821` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.341077 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] RBAC: Authorizing `identity:get_project(project_id=1622a1b2569948e4a8c2c82f66024821)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.343050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:16.343280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:16.344101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:16.345031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:16.346288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 224/447] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/projects/1622a1b2569948e4a8c2c82f66024821 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:16.346379 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 224/448] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:16.349813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:16.354067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:16.382558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:16.449533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:16.457448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98287-5873-41c9-9585-cf76d6c05648 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:16.462869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e5a39-5baa-4618-b68c-991738de74f6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:16.490751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.491426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.491693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.491970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] PATH_INFO: `/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.493149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] RBAC: Authorizing `identity:get_group(group_id=34f0bfb0eab4400ba5ba022aa7abb0ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.494649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.495708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.496310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.496445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 225/449] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/groups/34f0bfb0eab4400ba5ba022aa7abb0ce => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:16.497584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.497881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.498617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:16.498930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.500289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.502275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:16.508740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 225/450] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:16.514245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:16.595011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:16.602117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f293a-0646-4b76-827b-2568c8abf86d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:16.613651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023e75-c96b-438b-b291-53bb6fadbd7d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:16.642948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.643587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.643872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.644604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.645332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] RBAC: Adding query filter params (group.id=34f0bfb0eab4400ba5ba022aa7abb0ce, role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=1622a1b2569948e4a8c2c82f66024821) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:16.645800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.647265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.651047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.651893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.652163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.652604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.654298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 226/451] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/role_assignments?group.id=34f0bfb0eab4400ba5ba022aa7abb0ce&scope.project.id=1622a1b2569948e4a8c2c82f66024821&role.id=d138e21392054605846b1a7ee19e3814 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:16.672824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:16.726569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.728052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.834518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 226/452] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:19:16.840726 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:16.949623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810374fe-17d2-459b-869e-cd89501c3adf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:16.983678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:16.984323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:16.984595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:16.984876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] PATH_INFO: `/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:16.986158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] RBAC: Authorizing `identity:get_project(project_id=a6ce53165eb847a3be1e8ef59c28b2a1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:16.987604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:16.989261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 227/453] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/projects/a6ce53165eb847a3be1e8ef59c28b2a1 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:16.995016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:17.045049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:17.099322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa396561-422b-4239-a76c-9460d0748fb5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:17.137486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1c31d-3dc4-4c95-9c5e-629616b679a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:17.138115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c31d-3dc4-4c95-9c5e-629616b679a9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:17.138392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c31d-3dc4-4c95-9c5e-629616b679a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:17.138663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c31d-3dc4-4c95-9c5e-629616b679a9 None admin] PATH_INFO: `/v3/groups/fc871815fe85462295dab868a04a0558` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:17.139936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1c31d-3dc4-4c95-9c5e-629616b679a9 None admin] RBAC: Authorizing `identity:get_group(group_id=fc871815fe85462295dab868a04a0558)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:17.141411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1c31d-3dc4-4c95-9c5e-629616b679a9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:17.142997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 227/454] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Aug 8 02:19:16 2022] GET /identity/v3/groups/fc871815fe85462295dab868a04a0558 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:17.149288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:17.181613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:17.256562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd4c2-8a4d-461d-9b1d-2a1a1c26edad None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:17.290947 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325ab8-9a89-4be7-bf7e-15ee3df981e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:17.291544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325ab8-9a89-4be7-bf7e-15ee3df981e5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:17.291823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325ab8-9a89-4be7-bf7e-15ee3df981e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:17.292142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325ab8-9a89-4be7-bf7e-15ee3df981e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:17.292832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325ab8-9a89-4be7-bf7e-15ee3df981e5 None admin] RBAC: Adding query filter params (group.id=fc871815fe85462295dab868a04a0558, role.id=1470302d39e340299072b424021b764b, scope.project.id=a6ce53165eb847a3be1e8ef59c28b2a1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:17.293141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325ab8-9a89-4be7-bf7e-15ee3df981e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:17.294702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325ab8-9a89-4be7-bf7e-15ee3df981e5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:17.301113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 228/455] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Aug 8 02:19:17 2022] GET /identity/v3/role_assignments?group.id=fc871815fe85462295dab868a04a0558&scope.project.id=a6ce53165eb847a3be1e8ef59c28b2a1&role.id=1470302d39e340299072b424021b764b => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:19.661192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79383ee-9bee-4ef3-beb8-46775ee82910 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:19.662063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79383ee-9bee-4ef3-beb8-46775ee82910 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:19.662512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79383ee-9bee-4ef3-beb8-46775ee82910 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:19.664275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 228/456] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:19.670109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822db6b0-f7da-48ed-b54d-8762850a4cd7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:19.670889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822db6b0-f7da-48ed-b54d-8762850a4cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:19.671305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822db6b0-f7da-48ed-b54d-8762850a4cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:19.698805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-822db6b0-f7da-48ed-b54d-8762850a4cd7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:19.700565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-822db6b0-f7da-48ed-b54d-8762850a4cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:19.797340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 229/457] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:19.842873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79383ee-9bee-4ef3-beb8-46775ee82910 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:19.952143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35e35-da3b-4ccd-ad5d-bd75f4a7580e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:19.952497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35e35-da3b-4ccd-ad5d-bd75f4a7580e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:19.952769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35e35-da3b-4ccd-ad5d-bd75f4a7580e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:19.954354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 230/458] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:19.959299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0be6-dad4-4d95-8fdf-8522baa9e484 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:19.959581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0be6-dad4-4d95-8fdf-8522baa9e484 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:19.959853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0be6-dad4-4d95-8fdf-8522baa9e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:19.980624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79383ee-9bee-4ef3-beb8-46775ee82910 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:19.983090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c7bd0be6-dad4-4d95-8fdf-8522baa9e484 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:19.984281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c7bd0be6-dad4-4d95-8fdf-8522baa9e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:20.011055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.018055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.042126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.042767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.043046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.043317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.061874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.063342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.087055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 231/459] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:20.088597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805004-b5c7-4ab8-b520-367577faac8d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.089296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805004-b5c7-4ab8-b520-367577faac8d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.089931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805004-b5c7-4ab8-b520-367577faac8d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.095257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 232/460] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:20.096515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c76dd-7b0e-4324-a6bc-98bd3de35e17 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.096976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c76dd-7b0e-4324-a6bc-98bd3de35e17 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:20.097129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:20.098023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:20.098849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:20.098849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:20.098849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:20.098849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 229/461] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:20.099799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c76dd-7b0e-4324-a6bc-98bd3de35e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.104245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.118463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-710c76dd-7b0e-4324-a6bc-98bd3de35e17 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:20.119994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-710c76dd-7b0e-4324-a6bc-98bd3de35e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:20.190640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 233/462] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:20.191778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c76dd-7b0e-4324-a6bc-98bd3de35e17 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.255778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ce4a-c20c-40da-90a2-d5d695f7c1cf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.296869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.305701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.306342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.306623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.306895 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.307728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:20.308118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.309539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.322213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c76dd-7b0e-4324-a6bc-98bd3de35e17 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.323819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 230/463] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:20.325264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.360571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.361431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.361908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.362279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.364643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.374700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.376468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:20.393056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:20.394023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:20.394932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:20.394932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:20.394932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:20.399380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 234/464] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:20.400264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.455598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eda3d-406f-4ed4-90e1-43b4572841e4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.493348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.494312 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.494822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.495370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.506779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.506911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ec69-8a4e-46eb-9e2f-443f410b0ada None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.508836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:20.524931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:20.525923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:20.526970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:20.526970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:20.526970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:20.528780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 231/465] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:20.529799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.548326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284f76-2635-43b3-b292-3808859e26db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.548940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284f76-2635-43b3-b292-3808859e26db None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.549225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284f76-2635-43b3-b292-3808859e26db None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.549539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284f76-2635-43b3-b292-3808859e26db None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.550237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67284f76-2635-43b3-b292-3808859e26db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.551994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67284f76-2635-43b3-b292-3808859e26db None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.560493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.586873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 235/466] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:19:20 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:20.588082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284f76-2635-43b3-b292-3808859e26db None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.653749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.676571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082148c-9687-4fa4-839b-a7e552a577a7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.727810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284f76-2635-43b3-b292-3808859e26db None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.728384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8ed8-2207-4d2a-a673-3ed4a503a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.728573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8ed8-2207-4d2a-a673-3ed4a503a139 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.728814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8ed8-2207-4d2a-a673-3ed4a503a139 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.733409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8ed8-2207-4d2a-a673-3ed4a503a139 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.733409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8ed8-2207-4d2a-a673-3ed4a503a139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:20.733409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8ed8-2207-4d2a-a673-3ed4a503a139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.733409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f8ed8-2207-4d2a-a673-3ed4a503a139 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.749139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 232/467] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:20.750517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188008-9820-455f-a207-c27b5e0f63bb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.750802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188008-9820-455f-a207-c27b5e0f63bb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.751069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188008-9820-455f-a207-c27b5e0f63bb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.756632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 233/468] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:20.757593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188008-9820-455f-a207-c27b5e0f63bb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.767669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ba2dd-6148-4000-b888-e8f3832c02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.768384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba2dd-6148-4000-b888-e8f3832c02a8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.768736 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba2dd-6148-4000-b888-e8f3832c02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.769084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba2dd-6148-4000-b888-e8f3832c02a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.769884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba2dd-6148-4000-b888-e8f3832c02a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:20.770195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba2dd-6148-4000-b888-e8f3832c02a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.771588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba2dd-6148-4000-b888-e8f3832c02a8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.784187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 236/469] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:20.785510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b341b-db56-4e89-aee2-e9ef0c4db79d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.785862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b341b-db56-4e89-aee2-e9ef0c4db79d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.786142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b341b-db56-4e89-aee2-e9ef0c4db79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.806248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-807b341b-db56-4e89-aee2-e9ef0c4db79d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:20.807484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-807b341b-db56-4e89-aee2-e9ef0c4db79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:20.864928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.876910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188008-9820-455f-a207-c27b5e0f63bb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.892349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 237/470] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:20.893203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b341b-db56-4e89-aee2-e9ef0c4db79d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.933032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.933749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.934026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.934300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.934944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.936485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.960240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.968914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 234/471] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:19:20 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:20.970124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:21.014739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b341b-db56-4e89-aee2-e9ef0c4db79d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:21.061174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:21.061951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.062302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.062647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.063409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:21.065784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:21.109111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 238/472] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:19:20 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:21.121548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e10be8-6910-4beb-9b52-5b409a92aec0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:21.161880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829025c-1fc5-44b7-8075-8c8358979868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:21.162550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829025c-1fc5-44b7-8075-8c8358979868 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.162833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829025c-1fc5-44b7-8075-8c8358979868 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.163104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829025c-1fc5-44b7-8075-8c8358979868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.176299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829025c-1fc5-44b7-8075-8c8358979868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:21.177855 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829025c-1fc5-44b7-8075-8c8358979868 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8829025c-1fc5-44b7-8075-8c8358979868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:21.195173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:21.197273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:21.198511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:21.198511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:21.198511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:21.198511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 235/473] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:21.206066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:21.256339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:21.303779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd58f-3f65-4f08-b29a-ec1ceaab288a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.305829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd58f-3f65-4f08-b29a-ec1ceaab288a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.306110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd58f-3f65-4f08-b29a-ec1ceaab288a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.307942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 236/474] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:21.315599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a6000-21cf-4b04-b2af-799f42773c30 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.315983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a6000-21cf-4b04-b2af-799f42773c30 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.316167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a6000-21cf-4b04-b2af-799f42773c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.342706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc471e-26d9-4fe2-a6c9-5873ce68a09c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:21.343214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d97a6000-21cf-4b04-b2af-799f42773c30 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:21.344592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d97a6000-21cf-4b04-b2af-799f42773c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:21.392291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:21.392915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.393194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.393542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.394200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:21.394499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:21.395885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:21.410440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:21.412790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 239/475] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:21.419376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:21.436593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 237/476] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:21.466001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a6000-21cf-4b04-b2af-799f42773c30 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:21.527815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:21.534456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b40c34-2518-41de-ad68-89ab217fe623 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:21.587151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:21.587686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.587963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.588236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.589309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:21.592198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:21.618447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a6000-21cf-4b04-b2af-799f42773c30 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:21.641285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 240/477] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:19:21 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:21.667133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:21.667770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.668103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.668466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.669214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:21.670822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:21.684366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:19:21.684366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 02:19:21.684366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [parameters: {'id': '800ddd79939f44cdaadd6ab0f6edbcd4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 02:19:21.684366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Aug 08 02:19:21.706651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return ref.to_dict() Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:19:21.707581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:19:21.708479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:19:21.709327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:19:21.710214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:19:21.711005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'id': '800ddd79939f44cdaadd6ab0f6edbcd4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:21.711766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 02:19:21.712542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:21.713350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 238/478] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Aug 8 02:19:21 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:21.717467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:21.852424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33e603-e61a-4b80-ae61-91a2b0508ca1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:21.888184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080fad8-a581-485e-a1f9-d9ca51896c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:21.888875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080fad8-a581-485e-a1f9-d9ca51896c4b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:21.889156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080fad8-a581-485e-a1f9-d9ca51896c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:21.889486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080fad8-a581-485e-a1f9-d9ca51896c4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:21.900893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080fad8-a581-485e-a1f9-d9ca51896c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0080fad8-a581-485e-a1f9-d9ca51896c4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:21.906819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:21.908957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:21.910942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 241/479] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:21.914125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:21.963550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:22.020969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15284d0-3774-4f08-8c0f-cd56c01425e9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:22.055077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c61cb-d7fc-42f4-9950-852473dacdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:22.055595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c61cb-d7fc-42f4-9950-852473dacdbf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:22.055869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c61cb-d7fc-42f4-9950-852473dacdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:22.056135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c61cb-d7fc-42f4-9950-852473dacdbf None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:22.056861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c61cb-d7fc-42f4-9950-852473dacdbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:22.057165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c61cb-d7fc-42f4-9950-852473dacdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:22.058610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c61cb-d7fc-42f4-9950-852473dacdbf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:22.067583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 239/480] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:22.890709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35807e-e8fd-4031-adeb-3717ec4a49ef None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:22.891386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35807e-e8fd-4031-adeb-3717ec4a49ef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:22.891386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35807e-e8fd-4031-adeb-3717ec4a49ef None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:22.892771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 242/481] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:22.898508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e980-2d11-4852-814f-cdc7afd07a64 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:22.899028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e980-2d11-4852-814f-cdc7afd07a64 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:22.899028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e980-2d11-4852-814f-cdc7afd07a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:22.922379 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8549e980-2d11-4852-814f-cdc7afd07a64 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:22.923629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8549e980-2d11-4852-814f-cdc7afd07a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:23.018742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 240/482] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:23.070918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35807e-e8fd-4031-adeb-3717ec4a49ef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:23.094799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:23.216494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35807e-e8fd-4031-adeb-3717ec4a49ef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:23.271322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5ece3-b8e8-4a37-9cbc-e7ee70d7a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:23.271985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ece3-b8e8-4a37-9cbc-e7ee70d7a92f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:23.272261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ece3-b8e8-4a37-9cbc-e7ee70d7a92f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:23.272533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ece3-b8e8-4a37-9cbc-e7ee70d7a92f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:23.290156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5ece3-b8e8-4a37-9cbc-e7ee70d7a92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ece5ece3-b8e8-4a37-9cbc-e7ee70d7a92f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:23.295382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:23.296420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:23.297201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 243/483] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:23.302818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e980-2d11-4852-814f-cdc7afd07a64 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:23.357603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:23.445069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e980-2d11-4852-814f-cdc7afd07a64 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:23.461716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7391-1ed1-41fd-b1aa-9084402fce31 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:23.462113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7391-1ed1-41fd-b1aa-9084402fce31 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:23.462256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7391-1ed1-41fd-b1aa-9084402fce31 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:23.463662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 244/484] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:23.469338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a78bc-1e53-4809-b2d7-943cedd40e2d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:23.469648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a78bc-1e53-4809-b2d7-943cedd40e2d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:23.469851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a78bc-1e53-4809-b2d7-943cedd40e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:23.494517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:23.495643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:23.495920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:23.496259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:23.496941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:23.497240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:23.503654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:23.513625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e25a78bc-1e53-4809-b2d7-943cedd40e2d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:23.514825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e25a78bc-1e53-4809-b2d7-943cedd40e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:23.522940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 241/485] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:23.529388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:23.662547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 245/486] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:23.706261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:23.710436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a78bc-1e53-4809-b2d7-943cedd40e2d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:23.721333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:23.722595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d51d87-5e44-40e6-bdfc-dfddff06b73a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:23.804215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:23.804908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:23.805189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:23.805482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:23.831514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:23.834754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:23.873145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:23.874466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:23.875408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:23.875408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:23.875408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:23.878138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 242/487] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:23.881993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:23.958008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a78bc-1e53-4809-b2d7-943cedd40e2d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.001175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30390ac8-eb5c-4879-a775-03fd919c538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.001752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390ac8-eb5c-4879-a775-03fd919c538f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.002029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390ac8-eb5c-4879-a775-03fd919c538f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.002296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390ac8-eb5c-4879-a775-03fd919c538f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.016131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30390ac8-eb5c-4879-a775-03fd919c538f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-30390ac8-eb5c-4879-a775-03fd919c538f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:24.021973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:24.023953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 246/488] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:24.025498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0dac0-082e-41b8-a496-17bccdb1341c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.027006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0dac0-082e-41b8-a496-17bccdb1341c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.027006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0dac0-082e-41b8-a496-17bccdb1341c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.033414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 247/489] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:24.033414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0dac0-082e-41b8-a496-17bccdb1341c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.042958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58ce49-f007-4c1f-966d-14ec0f928923 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.086134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a8672-e049-460e-9e89-7e80554a43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.086980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8672-e049-460e-9e89-7e80554a43ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.087381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8672-e049-460e-9e89-7e80554a43ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.087772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8672-e049-460e-9e89-7e80554a43ac None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.088618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8672-e049-460e-9e89-7e80554a43ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:24.089081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8672-e049-460e-9e89-7e80554a43ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.090652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8672-e049-460e-9e89-7e80554a43ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:24.108411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 243/490] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:24.110052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80788161-95a1-41df-8c92-a1f3ad0cdba1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.110499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80788161-95a1-41df-8c92-a1f3ad0cdba1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.110948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80788161-95a1-41df-8c92-a1f3ad0cdba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.113481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.132436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-80788161-95a1-41df-8c92-a1f3ad0cdba1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:24.134051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-80788161-95a1-41df-8c92-a1f3ad0cdba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:24.138960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.167247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0dac0-082e-41b8-a496-17bccdb1341c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.215207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 244/491] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:24.216369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80788161-95a1-41df-8c92-a1f3ad0cdba1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.217690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.218816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.219309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.220743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.221648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:24.222158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.223728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:24.236003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 248/492] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:24.242810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.332558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80788161-95a1-41df-8c92-a1f3ad0cdba1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.364536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4e962-72f3-43a2-8c11-08a570b92708 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.366836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.367471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.367760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.368034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.375497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.377261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:24.379793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.391085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:24.391368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:24.392411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:24.393575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:24.397330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 245/493] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:24.398215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.405948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a232c4-89b2-46d5-bb18-79bfd8f0dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.406823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a232c4-89b2-46d5-bb18-79bfd8f0dd09 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.407288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a232c4-89b2-46d5-bb18-79bfd8f0dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.407748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a232c4-89b2-46d5-bb18-79bfd8f0dd09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.418761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a232c4-89b2-46d5-bb18-79bfd8f0dd09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.420216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a232c4-89b2-46d5-bb18-79bfd8f0dd09 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-d8a232c4-89b2-46d5-bb18-79bfd8f0dd09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:24.434597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:24.435487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:24.436341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:24.436341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:24.436341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:24.440334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 249/494] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:24.441604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413333be-9e2e-493c-99ca-6be32c57869b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.441883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413333be-9e2e-493c-99ca-6be32c57869b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.442153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413333be-9e2e-493c-99ca-6be32c57869b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.443531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 250/495] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:24.448097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413333be-9e2e-493c-99ca-6be32c57869b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.507471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461be00-2a47-4d5d-9ba1-94f9fb2fe556 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.544280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.544923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.545202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.545507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.555609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413333be-9e2e-493c-99ca-6be32c57869b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.555781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:24.561934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:24.562806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:24.563586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 246/496] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:24.564245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.599168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87899ffa-2962-40c3-8fcb-3fa99c4e5f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.599686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899ffa-2962-40c3-8fcb-3fa99c4e5f93 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.599963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899ffa-2962-40c3-8fcb-3fa99c4e5f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.600229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899ffa-2962-40c3-8fcb-3fa99c4e5f93 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.600963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87899ffa-2962-40c3-8fcb-3fa99c4e5f93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:24.601267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87899ffa-2962-40c3-8fcb-3fa99c4e5f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.602738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87899ffa-2962-40c3-8fcb-3fa99c4e5f93 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:24.637750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.645128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 251/497] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:24.645128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47986-f8bc-4e28-917a-53e9f404577f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.645128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47986-f8bc-4e28-917a-53e9f404577f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.645128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47986-f8bc-4e28-917a-53e9f404577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.660598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a8e47986-f8bc-4e28-917a-53e9f404577f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:24.661824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a8e47986-f8bc-4e28-917a-53e9f404577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:24.684716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a143c-22d8-4aa2-a1ea-e27d5cf3bf54 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.691078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.721089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.721738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.722008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.722276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.722916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:24.723216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.724602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:24.734640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 252/498] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:24.741594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 247/499] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:24.741594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.746330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e47986-f8bc-4e28-917a-53e9f404577f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.846166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e6cc-5fd2-4694-8816-27b21dd22cbf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.852942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e47986-f8bc-4e28-917a-53e9f404577f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:24.868182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.883671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.884508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.884935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.885204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.889448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:24.890065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:24.890339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:24.890606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:24.891296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:24.891596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.892974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:24.906012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 253/500] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:24.906012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:24.934503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:24.963634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:24.965222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.011310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776be3a-ed21-4bb5-a39f-1a2d1682f0bb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.047653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.048292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.048572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.048835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.055854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.057569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.063521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 248/501] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:25.064363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:25.075392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:25.076474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 254/502] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:25.077403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.086512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.163385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.166913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fcff3-f287-414c-8494-4d29d1432b4f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.178198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3019e-a7ca-4275-ae04-699c134250c4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.199758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207098ed-748a-420a-8653-5ee2a0023155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.200735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207098ed-748a-420a-8653-5ee2a0023155 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.201021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207098ed-748a-420a-8653-5ee2a0023155 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.201300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207098ed-748a-420a-8653-5ee2a0023155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.211111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207098ed-748a-420a-8653-5ee2a0023155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:25.212467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.213090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.213390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.213695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-207098ed-748a-420a-8653-5ee2a0023155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:25.215862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:25.216877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:25.217725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 249/503] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:25.218711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779609f-f9d6-465e-98f2-3579645a3f28 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.218978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779609f-f9d6-465e-98f2-3579645a3f28 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.219259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779609f-f9d6-465e-98f2-3579645a3f28 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.220797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 250/504] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:25.221526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779609f-f9d6-465e-98f2-3579645a3f28 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.228460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.230150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:25.244598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:25.245806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:25.246632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:25.246632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:25.246632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:25.246632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 255/505] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:25.246955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.309545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.331863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779609f-f9d6-465e-98f2-3579645a3f28 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.346994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fba52-f365-4b82-baf1-283ddc039783 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.364561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.365192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.365521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.365795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.375693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.377133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.379665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b4858-b5b6-4e04-ae9d-e304f43e2bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.380269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b4858-b5b6-4e04-ae9d-e304f43e2bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.380549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b4858-b5b6-4e04-ae9d-e304f43e2bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.380827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b4858-b5b6-4e04-ae9d-e304f43e2bb5 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.381589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b4858-b5b6-4e04-ae9d-e304f43e2bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:25.381897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b4858-b5b6-4e04-ae9d-e304f43e2bb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.383355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b4858-b5b6-4e04-ae9d-e304f43e2bb5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:25.391401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:25.392324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:25.393139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:25.393139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:25.393139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:25.393296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.393361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 251/506] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:25.393361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.404950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 256/507] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:25.406240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e486-4161-4d65-9020-a96d3165f06e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.406523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e486-4161-4d65-9020-a96d3165f06e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.406796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e486-4161-4d65-9020-a96d3165f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.424544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-56f6e486-4161-4d65-9020-a96d3165f06e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:25.425704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-56f6e486-4161-4d65-9020-a96d3165f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:25.490293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 257/508] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:25.491164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e486-4161-4d65-9020-a96d3165f06e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.494302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd1bd-4d56-47a0-a20b-faddadcdfc6a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.523624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.529704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.530314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.530594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.530862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.531529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:25.531829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.533197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.541198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 252/509] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:25.542041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.591943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e486-4161-4d65-9020-a96d3165f06e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.617622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.629491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.630107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.630385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.630663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.631299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:25.631590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.632986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.644264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5352-aaa8-4246-9076-7b0d4efaaf00 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.645152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 258/510] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:25.645982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.679060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.679680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.680009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.680282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.680925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:25.681229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.682902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.694612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 253/511] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:25.695426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.752552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd3dca-da27-438c-8e44-71dc66afc554 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.753558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.785858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.786492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.786767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.787040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.798878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ff81c-aa65-4f1f-aeca-7cb5d17bb23d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.835582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.836219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.836493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.836758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.846354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.846570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.848108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.860152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.861672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:25.862602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:25.863455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:25.864275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:25.864275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:25.864275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:25.864275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 254/512] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:25.864515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.964500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 259/513] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:25.965640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.973442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463cc97-020b-44dd-873d-e12ab94dcbd7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.980598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.007961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.008591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.008869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.009138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.019903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.021428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:26.035200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:26.036084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:26.036900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:26.036900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:26.036900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:26.036900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 255/514] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:26.037114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.054342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.070669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cc169-9acf-49ac-a0ca-84d7d27b0efb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.106658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.107348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.107632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.107904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.115140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.116613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:26.128104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:26.129019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:26.129923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 260/515] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:26.130457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.143224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1906d-2d65-4255-bb76-bf7054e9cfbd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.178114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.178745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.179025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.179295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.186519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.187974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:26.199677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:26.200987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 256/516] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:26.206596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.225054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.227608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55144d-cdaf-4f71-a684-59fb1f7d5e70 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.260905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.261542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.261826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.262108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.262758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:26.263063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.264460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.275891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 261/517] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:26.276877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.286210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.309836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866d09-55c6-4be4-810b-a1142dcb5557 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.342936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.343568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.343853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.344124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.354665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.356110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:26.370030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:26.371085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:26.371902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:26.371902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:26.371902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:26.371902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 257/518] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:26.371902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.379424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd0e2b-5b74-4fbb-951e-d11de565d84b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.412378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.412989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.413268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.413570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.414212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:26.414513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.415904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.427704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 262/519] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:26.428505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.443437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.476294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d03f5a-c9eb-4d67-9c54-88c512e1ec3e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.492131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.510756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.511652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.511932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.512181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.512900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:26.513202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.514681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.525919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef67a-d923-481f-8a15-b14998e338fe None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 258/520] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:26.552354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.561908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.562514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.562789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.563056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.563724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:26.564042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.565496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.583412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 263/521] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:26.584192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.661528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcad61-14dd-4f47-b779-4f6ef45ef7b3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.686082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde00f-350b-4b9f-93cf-9bafb44c37b1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.687400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.695718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.696321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.696597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.696862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.697527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.699068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.711942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.721928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 259/522] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:19:26 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:26.722562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.722766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.723398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.723683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.723960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.724614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:26.724917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.726433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.739274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 264/523] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:26.740425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.855693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee71f71-70b2-43eb-9f68-1770987c367f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.857265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19ece-f292-42e3-99c5-6d4706b660c4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:26.894442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.894933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.895211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.895481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.896419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:26.897423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:26.897423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:26.897648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:26.903625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.905131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:26.919009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:26.920060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:26.920907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 260/524] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:26.922061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:26.961615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.974295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:26.976073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:26.977715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.033249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaf3de-b883-4c49-adce-394fd847e9c6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.069998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.070616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.070903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.071178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.071912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e0097046a5f7407d84884097fcfc4ba3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:27.072243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.074128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.079074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 265/525] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:27.080458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.085562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 261/526] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:26 2022] GET /identity/v3/role_assignments?user.id=e0097046a5f7407d84884097fcfc4ba3&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:27.086826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.184465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:27.202161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca849-01f5-4c90-99f5-1033748fb355 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.238023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59d4d-c98a-4792-be73-85ed6d68b6a6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.242651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.243364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.243714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.244050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.251804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:27.253655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.261802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:27.268260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:27.269114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:27.270005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 266/527] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:27.270461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.282661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.283720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.284417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.284877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.285738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:27.286362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.288655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.317450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 262/528] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:27.318358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.397716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35f0a-f387-41bc-b7e6-7b1091e95115 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.432781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6550c35-9433-45db-930c-cfc693b88426 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.434108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.434756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.435036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.435312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.449160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.451109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.458863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:27.467520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:27.468444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:27.474037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:27.474037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:27.474037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:27.474037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 267/529] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:27.477615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.488294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.489121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.489611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.490025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.490869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:27.491368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.493054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.520318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 263/530] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:27.521626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.557778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:27.604630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342cc0f-9747-4577-98ec-ad986ccb0dde None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.648873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.649772 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.650196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.650608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.650731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19749082-f11f-44a6-b5d8-c6f9cc7804fe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.687841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.688695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.688979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.689347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.690119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:27.690511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.692050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.709422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 264/531] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:27.709422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.739572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:27.744507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.747036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.805637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:27.826918 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20b20-c751-4abc-9b02-77468cd4cbda None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:27.868737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:27.870164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.870436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.870889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.871406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=913aaeebb773479e8c4cb64bb588fa34) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:27.871717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:27.873169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:27.879645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 265/532] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/role_assignments?user.id=913aaeebb773479e8c4cb64bb588fa34&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:27.880634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:27.882001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 268/533] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:27.891526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.077018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.079179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124b8b-6f6d-450c-8bc9-36fa2a081b7a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:28.081468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f24c-6681-4f2c-86b8-941ec35d3937 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:28.116654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:28.117296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.118167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.118167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.121773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:28.122572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.122993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.123420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.125872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:28.127424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:28.139523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:28.140377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:28.141218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 266/534] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:28.146379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:28.147883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:28.150336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.164893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:28.179175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:28.180075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:28.180932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:28.180932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:28.180932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:28.187621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 269/535] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:28.194633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.291187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f8294-ade7-4af9-8d1b-ad1dbe6b628e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:28.361751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:28.362287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.362568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.362842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.364802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:28.365115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:28.366596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:28.398347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2944b-bd79-44a3-a74d-a5a356a3c268 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:28.400001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 267/536] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:28.402559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.491828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.510103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:28.510764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.511042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.511318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.511968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:28.512270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:28.513694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:28.528077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19890084-2e9e-405d-9448-efd37416fb38 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:28.539973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 270/537] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:28.545815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.570548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.575753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:28.576631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.577145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.577636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.580103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=2d691f1a09e14fc5a1858b1ac3bdd026) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:28.581999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:28.584493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:28.598512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 268/538] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:28 2022] GET /identity/v3/role_assignments?user.id=2d691f1a09e14fc5a1858b1ac3bdd026&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:28.697059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd7d8-fc97-4c37-806f-e59e623fed7b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:28.752186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9b923-a15a-43c7-8e4c-1ae24c9c8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:28.752849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9b923-a15a-43c7-8e4c-1ae24c9c8652 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.753126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9b923-a15a-43c7-8e4c-1ae24c9c8652 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.753416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9b923-a15a-43c7-8e4c-1ae24c9c8652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.767780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9b923-a15a-43c7-8e4c-1ae24c9c8652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:28.769284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9b923-a15a-43c7-8e4c-1ae24c9c8652 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cbb9b923-a15a-43c7-8e4c-1ae24c9c8652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:28.783927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:28.784905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:28.785771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 271/539] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:28.794543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.795040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55135c3-2203-4280-9c07-be397a7ac40f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.795338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55135c3-2203-4280-9c07-be397a7ac40f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.795612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55135c3-2203-4280-9c07-be397a7ac40f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.797605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 272/540] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:28.803774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4193cb-f3e5-49d4-9089-2854274d11d1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.804055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4193cb-f3e5-49d4-9089-2854274d11d1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.804329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4193cb-f3e5-49d4-9089-2854274d11d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.829035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2b4193cb-f3e5-49d4-9089-2854274d11d1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:28.830266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2b4193cb-f3e5-49d4-9089-2854274d11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:28.908260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.915319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 273/541] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:28.941063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4193cb-f3e5-49d4-9089-2854274d11d1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.960919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ff82-745d-411b-8eea-95b52725fdfc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.029347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.029989 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.030264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.030528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.031234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:29.031530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:29.032974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:29.036326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:29.053128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 269/542] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:29.059090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:29.124907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4193cb-f3e5-49d4-9089-2854274d11d1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.187654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.189601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.190206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.191211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.216920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:29.222219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:29.223163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:29.223943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:29.229999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 274/543] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:29.230782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:29.247901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f60bcb-4803-4222-8a37-8efeee894729 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.287965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e15f2-eb05-4adf-a6c6-903694c44b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.288594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e15f2-eb05-4adf-a6c6-903694c44b82 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.288904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e15f2-eb05-4adf-a6c6-903694c44b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.289178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e15f2-eb05-4adf-a6c6-903694c44b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.289945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e15f2-eb05-4adf-a6c6-903694c44b82 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=64c5c41465004c0a81fced6e8834a5d0) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:29.290248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e15f2-eb05-4adf-a6c6-903694c44b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:29.291938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e15f2-eb05-4adf-a6c6-903694c44b82 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:29.298596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 270/544] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:29 2022] GET /identity/v3/role_assignments?user.id=64c5c41465004c0a81fced6e8834a5d0&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:29.299662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c20a7-8304-42c0-93e0-121bd17af887 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.299919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c20a7-8304-42c0-93e0-121bd17af887 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.300253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c20a7-8304-42c0-93e0-121bd17af887 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.301836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 271/545] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:29.315506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:29.321396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a5e1-49e4-4715-ac02-455f4a0b6d77 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.321396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a5e1-49e4-4715-ac02-455f4a0b6d77 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.321396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a5e1-49e4-4715-ac02-455f4a0b6d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.358746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6862a5e1-49e4-4715-ac02-455f4a0b6d77 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:29.360191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6862a5e1-49e4-4715-ac02-455f4a0b6d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:29.370760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef808b8-89cb-4a3d-a84b-23d72fe3182f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.411632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.412258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.412533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.412803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.413618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:29.413936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:29.415426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:29.426232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 275/546] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:29.432001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:29.520787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:29.545337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b541-c61e-4839-9caa-4ced85738249 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.559702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 272/547] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:29.568985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:29.582377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.583009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.583286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.583557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.594037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a5e1-49e4-4715-ac02-455f4a0b6d77 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:29.595536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:29.597165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:29.617392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:29.618350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:29.619156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:29.619156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:29.619156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:29.619156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 276/548] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:29.622629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:29.729182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387a5b4-da67-41ef-8c5d-0a1ae092f74e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.751275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a5e1-49e4-4715-ac02-455f4a0b6d77 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.765144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.765785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.766061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.766335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.766984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:29.767287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:29.768788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:29.782317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 277/549] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:29.793401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:29.812421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.813409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.813884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.814341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.825395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:29.834452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:29.841224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:29.842637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:29.843672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:29.849583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 273/550] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:29.853800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:29.940423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13aae-f084-47de-bfc4-3df3b3ea445b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:29.963276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:29.979362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:29.980163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:29.980370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:29.980639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:29.988388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:29.989869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:30.002588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:30.003538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:30.004414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 278/551] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:30.009982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.112567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:30.113176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2bb1-959c-44ed-be0c-e3ed54f24985 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.121307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba46a1-f44c-473a-abae-cd4e0ff903be None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.157723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.158389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.158621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.158899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.159636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:30.159936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.161394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.179985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 279/552] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:30.185891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.206987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.207616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.207893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.208164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.208841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:30.209140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.210556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.224381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 274/553] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:30.234428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.293315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a405-4508-45b7-866a-37dfed1b926d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.334679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf1fbd-f78e-478f-a89d-b39ea214a413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.335289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf1fbd-f78e-478f-a89d-b39ea214a413 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.335566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf1fbd-f78e-478f-a89d-b39ea214a413 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.339460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf1fbd-f78e-478f-a89d-b39ea214a413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.382936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:30.438982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471477e-dcc6-49a9-92a5-3534d4206d41 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.454130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:30.459182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf1fbd-f78e-478f-a89d-b39ea214a413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.461281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf1fbd-f78e-478f-a89d-b39ea214a413 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.484527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa53360-ca4d-4cdc-8b53-e16bcc85353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.485212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa53360-ca4d-4cdc-8b53-e16bcc85353c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.485524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa53360-ca4d-4cdc-8b53-e16bcc85353c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.485785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa53360-ca4d-4cdc-8b53-e16bcc85353c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.500579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa53360-ca4d-4cdc-8b53-e16bcc85353c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.503013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa53360-ca4d-4cdc-8b53-e16bcc85353c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-eaa53360-ca4d-4cdc-8b53-e16bcc85353c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:30.522324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:30.523287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:30.524167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:30.524167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:30.524167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:30.524343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 275/554] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:30.525773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c9f6-11ee-494b-a06d-948fb28292fc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.526389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c9f6-11ee-494b-a06d-948fb28292fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.526899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c9f6-11ee-494b-a06d-948fb28292fc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.528802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 276/555] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:30.529762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c9f6-11ee-494b-a06d-948fb28292fc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.587220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 280/556] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:30.588777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74c83e-9f92-4c58-b7d8-3dccf6f9c490 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.589495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74c83e-9f92-4c58-b7d8-3dccf6f9c490 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.589495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74c83e-9f92-4c58-b7d8-3dccf6f9c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.611386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2e74c83e-9f92-4c58-b7d8-3dccf6f9c490 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:30.618384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2e74c83e-9f92-4c58-b7d8-3dccf6f9c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:30.666303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c9f6-11ee-494b-a06d-948fb28292fc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.677579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:30.702421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.703077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.703349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.703621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.704261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:30.704559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.706088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 281/557] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:30.707890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74c83e-9f92-4c58-b7d8-3dccf6f9c490 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.713694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.736299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 277/558] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:30.741588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.767609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:30.818454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74c83e-9f92-4c58-b7d8-3dccf6f9c490 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.844069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c27cd-2b1e-412c-918a-0287ee0cf6b4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.855732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.856635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.857126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.857615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.868682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.870722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.878951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.879452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.879732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.880054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.887946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:30.888942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:30.889861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:30.890723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:30.890723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:30.890723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:30.890887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.897531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 282/559] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:30.898783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:30.903094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:30.904016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:30.905040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 278/560] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:30.905675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.939717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:30.989480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.008023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39873ae-feb1-4671-9729-36e04221ec1a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.014604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633e3-f4d1-445f-a76c-8d852de64f2e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.042745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.043360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.043635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.043903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.044552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:31.044851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.046415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.053250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641e30-1495-44f0-ad57-b02c2ec35b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.053936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641e30-1495-44f0-ad57-b02c2ec35b3a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.054212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641e30-1495-44f0-ad57-b02c2ec35b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.054481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641e30-1495-44f0-ad57-b02c2ec35b3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.060022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 279/561] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:31.060706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.067039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641e30-1495-44f0-ad57-b02c2ec35b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1a641e30-1495-44f0-ad57-b02c2ec35b3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:31.071765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:31.075229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 283/562] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:31.082616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc740-8bfe-4c98-b394-910471d48109 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.084509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc740-8bfe-4c98-b394-910471d48109 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.084509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc740-8bfe-4c98-b394-910471d48109 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.084509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 284/563] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:31.084509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc740-8bfe-4c98-b394-910471d48109 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.168581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722555b-28d9-4470-8f85-63a926361cda None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.187450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.195536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc740-8bfe-4c98-b394-910471d48109 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.205820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c3cdd-5895-42ba-859e-bac2b6c19481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.206431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3cdd-5895-42ba-859e-bac2b6c19481 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.206874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3cdd-5895-42ba-859e-bac2b6c19481 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.207142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3cdd-5895-42ba-859e-bac2b6c19481 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.207868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c3cdd-5895-42ba-859e-bac2b6c19481 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:31.208170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c3cdd-5895-42ba-859e-bac2b6c19481 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.209765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c3cdd-5895-42ba-859e-bac2b6c19481 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.224687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.228651 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 280/564] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:31.230171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e560c12-9a22-4f54-92a4-2c6b6ac44fb2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.230514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e560c12-9a22-4f54-92a4-2c6b6ac44fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.230847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e560c12-9a22-4f54-92a4-2c6b6ac44fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.237837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.238517 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.239418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.239418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.246962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.248428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.250043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7e560c12-9a22-4f54-92a4-2c6b6ac44fb2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:31.251241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7e560c12-9a22-4f54-92a4-2c6b6ac44fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:31.261153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:31.262083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:31.262922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 285/565] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:31.263387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.330220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 281/566] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:31.331108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e560c12-9a22-4f54-92a4-2c6b6ac44fb2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.387789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36032c-e980-4dd7-aaa1-d4f31fd9a0e2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.424141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.424840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.425213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.425520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.426181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:31.426479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.427962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.431123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e560c12-9a22-4f54-92a4-2c6b6ac44fb2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.441398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 286/567] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:31.441398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.461697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.464781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.471952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.472596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.472871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.473136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.483967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.485445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:31.500539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:31.501494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:31.502364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:31.502364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:31.502364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:31.502364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 282/568] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:31.502578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.555647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4a9d-a3c0-4f25-9e64-4b5bb682b77e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.588570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.589170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.589476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.589754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.590442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:31.590741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.592180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.603864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 287/569] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:31.604047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879572e-dc79-4eb0-b90f-453cad430f14 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.604838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.640454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.641086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.641360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.641654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.652177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:31.657356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:31.658271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:31.659065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 283/570] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:31.659734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.684690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.703612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.707806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568b02-411b-41bc-bb5c-9904c2323dbe None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.744109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd78517-7187-4040-ad28-991e96bb0e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.744665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78517-7187-4040-ad28-991e96bb0e35 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.745457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78517-7187-4040-ad28-991e96bb0e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.745739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78517-7187-4040-ad28-991e96bb0e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.755823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd78517-7187-4040-ad28-991e96bb0e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.757285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd78517-7187-4040-ad28-991e96bb0e35 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.759885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d656bc-2da5-4768-abc9-18d11d4e0177 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0cd78517-7187-4040-ad28-991e96bb0e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:31.775128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:31.776191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:31.777154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:31.777154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:31.777154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:31.777154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 288/571] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:31.778003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88e211-f66c-4316-b5e1-f483ec97befe None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.778106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88e211-f66c-4316-b5e1-f483ec97befe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.778370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88e211-f66c-4316-b5e1-f483ec97befe None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.783883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 289/572] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:31.783883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88e211-f66c-4316-b5e1-f483ec97befe None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.800217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.800822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.801102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.801386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.802064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:31.802371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.803769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.816313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 284/573] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:31.817223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.890938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88e211-f66c-4316-b5e1-f483ec97befe None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.917284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.920541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0583385-a9d2-4b6c-98ae-b2712ac03c4d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:31.922109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:31.925701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.926308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.926589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.926861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.927586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=4a07806d34b143f186cfc63ea192d6c1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:31.927894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.929331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.935393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 290/574] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/role_assignments?user.id=4a07806d34b143f186cfc63ea192d6c1&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:31.936154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:31.962894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870934e0-a7b3-48fe-84a7-af6e1865304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:31.963306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870934e0-a7b3-48fe-84a7-af6e1865304d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.963748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870934e0-a7b3-48fe-84a7-af6e1865304d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.964116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870934e0-a7b3-48fe-84a7-af6e1865304d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:31.964819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870934e0-a7b3-48fe-84a7-af6e1865304d None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:31.965457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870934e0-a7b3-48fe-84a7-af6e1865304d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:31.966883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870934e0-a7b3-48fe-84a7-af6e1865304d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:31.981432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 285/575] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:31.981432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d82f9-8263-4d90-aae8-a120082c1b7d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:31.981432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d82f9-8263-4d90-aae8-a120082c1b7d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:31.981432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d82f9-8263-4d90-aae8-a120082c1b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.001050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c64d82f9-8263-4d90-aae8-a120082c1b7d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:32.002268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c64d82f9-8263-4d90-aae8-a120082c1b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:32.056013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a75c2b-40d6-4a67-90bf-1a5bc7271eea None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.082967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 286/576] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:32.083846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d82f9-8263-4d90-aae8-a120082c1b7d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.102350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.102948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.103255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.103496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.104223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:32.104519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.106036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.119940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 291/577] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:32.120863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.177172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.200648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.209917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d82f9-8263-4d90-aae8-a120082c1b7d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.227030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6e4f3-d247-473a-81e0-7779766e0b66 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.251816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.252881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.253169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.253904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.261037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.261731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.262010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.262281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.262701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.264551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.272930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.274410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:32.276832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:32.277758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:32.278622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 287/578] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:32.279122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:32.296000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:32.297188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:32.298466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:32.298466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:32.298466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:32.301735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 292/579] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:32.302562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.383980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fbdd9-254c-4f84-aa5f-d97e6ada00a1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.408274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8931e9-84e8-4e2b-aa18-e894226939df None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.410781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.418747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.419390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.419667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.420310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.432769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:32.439009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:32.439924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:32.440738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 288/580] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:32.441545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.449283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.450481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.450895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.451321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.459413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.461439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.461639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:32.474194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:32.475320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:19:32.476443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:32.478256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 293/581] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:32.479254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.555235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704438-23eb-4acf-a3e9-e181ccb058d3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.587499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abff9ce-85f1-4cc9-a275-754c34c47830 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.589741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.590341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.590641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.590899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.591572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:32.591870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.593290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.605632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 289/582] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:32.611092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.634823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.635641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.636107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.636463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.637218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:32.637562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.639032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.655982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 294/583] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:32.655982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.679263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.701483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.728537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72257e3-cfa7-45c3-8f63-6657e9f09175 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.757529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75410708-80da-4a7a-824b-df53d7aed287 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.763378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.764035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.764267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.764536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.765196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:32.765851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.766886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.775990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 290/584] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:32.776784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.797297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.798002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.798339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.798679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.799474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:32.799843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.801346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.825591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 295/585] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:32.826368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.885592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68095088-fa6e-4080-89af-be38c36558ad None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.913811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.921558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.922221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.922497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.922768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e0097046a5f7407d84884097fcfc4ba3/roles/d8d8369da6884d00a8c296ddc1619fb6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.926707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:32.934242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131464b7-e76f-4bf1-b6e2-9d8d32837ac1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:32.940171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=e0097046a5f7407d84884097fcfc4ba3, role_id=d8d8369da6884d00a8c296ddc1619fb6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:32.942015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:32.958141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 291/586] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:32 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e0097046a5f7407d84884097fcfc4ba3/roles/d8d8369da6884d00a8c296ddc1619fb6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:32.958934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:32.981913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:32.983710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:32.984207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:32.984953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:32.996731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.000104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:33.017605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:33.018641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:19:33.019539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:33.023033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 296/587] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:33.024545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.078125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42337f7e-bf37-44bb-bc09-f02edfe81269 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.127635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.127635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.128168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.128532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.143436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.145570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:33.162245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:33.163405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:33.164486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:33.164486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:33.164486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:33.165491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 292/588] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:33.166497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.172621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9104125-223d-43d9-a136-a48b4a1fdb37 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.214303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.215492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.216806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.217259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.222154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:33.235093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.236581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.241848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:33.260247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:33.261433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:33.262393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:33.262393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:33.262393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:33.265008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 297/589] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:33.270177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.304135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae991-1b4e-4842-b3f6-e90a2e78612f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.339969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.340917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.341452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.341933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.342857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:33.343390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.345032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.363645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 293/590] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:33.364914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.380641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639532-2e6a-4f71-91dc-6a6e2bdf9fad None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.418400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.418979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.419263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.419538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.420194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:33.420771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.422134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.435545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 298/591] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:33.436463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.468557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:33.475356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9220ba-199e-4d94-8e9d-22c672ebea03 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.496465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:33.511717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.512696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.513188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.513676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.514521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:33.515063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.516645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.533682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 294/592] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:33.534922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.546628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d6816-ce37-4a63-9d4b-9f0ce9ec1606 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.584352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.584987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.585324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.585681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.597146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.598676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:33.615884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:33.616871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:33.617769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:33.617769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:33.617769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:33.617769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 299/593] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:33.618435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.645700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abb83-a96b-4fd2-90cd-62d67f049af0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.684807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.685908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.686488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.687038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.696169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.698169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:33.711659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:33.712668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:19:33.713705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:33.716453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 295/594] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:33.717714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.739248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:33.825161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576807c-84fa-4167-b2a0-663519b1f25d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.858053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461d09f-ee5e-4a70-9cdf-6abd61e7c94c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:33.859881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.860763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.861238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.861723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.862560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:33.863070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.864648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.865243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:33.878186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 296/595] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:33.879398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.897672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:33.898338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:33.898619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:33.898893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:33.906680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:33.908404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:33.921485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:33.922394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:33.923289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:33.927156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 300/596] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:33.928330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:33.968508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:33.990789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa995786-5fec-4059-b251-70968c129fcd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.028325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.028934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.029308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.029678 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.030582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:34.030890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.032329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.033107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee989-0c60-4381-8c5b-fbbabf618a1d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.059566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 297/597] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:34.059566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.080854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8efc3c-4f04-446d-ae64-e1ca4a7ca63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.081492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8efc3c-4f04-446d-ae64-e1ca4a7ca63a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.081771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8efc3c-4f04-446d-ae64-e1ca4a7ca63a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.082046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8efc3c-4f04-446d-ae64-e1ca4a7ca63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.089309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8efc3c-4f04-446d-ae64-e1ca4a7ca63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.090787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8efc3c-4f04-446d-ae64-e1ca4a7ca63a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4e8efc3c-4f04-446d-ae64-e1ca4a7ca63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:34.102017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:34.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:34.104711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 301/598] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:34.105202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d6dc-c1e5-4ffe-8fb7-0e9d2152656d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.105202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d6dc-c1e5-4ffe-8fb7-0e9d2152656d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.105324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d6dc-c1e5-4ffe-8fb7-0e9d2152656d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.106732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 302/599] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:34.107507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d6dc-c1e5-4ffe-8fb7-0e9d2152656d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.139608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:34.183583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485158-e82d-4daf-9830-6dd32f96b716 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.217896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.218506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.218788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.219062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.219763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:34.220069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.221591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.222129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d6dc-c1e5-4ffe-8fb7-0e9d2152656d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.223239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:34.234648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 298/600] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:34.235475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.259379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c19b0-2fed-4630-84ea-a1bd9dadbfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.260021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c19b0-2fed-4630-84ea-a1bd9dadbfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.260394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c19b0-2fed-4630-84ea-a1bd9dadbfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.260736 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c19b0-2fed-4630-84ea-a1bd9dadbfc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.272357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c19b0-2fed-4630-84ea-a1bd9dadbfc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.274061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c19b0-2fed-4630-84ea-a1bd9dadbfc3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9d8c19b0-2fed-4630-84ea-a1bd9dadbfc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:34.288095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:34.289042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:34.294989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:34.294989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:34.294989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:34.294989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 303/601] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:34.294989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dad8b-31c1-401a-9fe4-6941319872ff None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.294989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dad8b-31c1-401a-9fe4-6941319872ff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.294989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dad8b-31c1-401a-9fe4-6941319872ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.310089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e40dad8b-31c1-401a-9fe4-6941319872ff None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:34.311281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e40dad8b-31c1-401a-9fe4-6941319872ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:34.352152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01ce6-23f4-40df-8797-232f5917fca9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.380317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 304/602] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:34.381132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dad8b-31c1-401a-9fe4-6941319872ff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.397441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.398699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.400001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:34.400262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.401476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.403938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:34.405115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.408201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.432539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 299/603] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:34.434889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.500936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:34.513317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dad8b-31c1-401a-9fe4-6941319872ff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.548625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.549068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f551e7b-32c4-4893-aa4e-14d98ac0f651 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.549292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.549599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.549878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/913aaeebb773479e8c4cb64bb588fa34/roles/d8d8369da6884d00a8c296ddc1619fb6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.564223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=913aaeebb773479e8c4cb64bb588fa34, role_id=d8d8369da6884d00a8c296ddc1619fb6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.565704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.582066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 305/604] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:34 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/913aaeebb773479e8c4cb64bb588fa34/roles/d8d8369da6884d00a8c296ddc1619fb6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:34.583199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.599690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.600806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.601090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.601390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.602074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:34.602384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.603998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.629630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 300/605] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:34.630383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.693583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:34.744166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4ef1e-88dc-4d46-9596-486f18654cb4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.756867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee355092-64e1-4264-bb3a-2d4257417e63 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:34.772412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:34.785292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.786321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.786781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.787233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.797482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:34.798158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:34.798437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:34.798711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/2d691f1a09e14fc5a1858b1ac3bdd026/roles/d8d8369da6884d00a8c296ddc1619fb6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:34.800706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:34.808849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:34.809869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:34.810699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:34.812006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 306/606] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:34.812006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.820646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=2d691f1a09e14fc5a1858b1ac3bdd026, role_id=d8d8369da6884d00a8c296ddc1619fb6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:34.823045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:34.844188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 301/607] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:34 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/2d691f1a09e14fc5a1858b1ac3bdd026/roles/d8d8369da6884d00a8c296ddc1619fb6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:34.846180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:34.983140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ce3bb-4b06-48f3-8b58-f9af576816e9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.020965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7c64a-7db2-4cbb-87f8-59901314b089 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.026258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdced802-3850-425f-9fca-089acb9da012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.028142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced802-3850-425f-9fca-089acb9da012 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.028674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced802-3850-425f-9fca-089acb9da012 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.029139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced802-3850-425f-9fca-089acb9da012 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.030040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdced802-3850-425f-9fca-089acb9da012 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:35.030539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdced802-3850-425f-9fca-089acb9da012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.032159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdced802-3850-425f-9fca-089acb9da012 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.042730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 302/608] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:35.044085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c31bc-8595-4ca0-b134-ba70dde76176 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.044376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c31bc-8595-4ca0-b134-ba70dde76176 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.044916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c31bc-8595-4ca0-b134-ba70dde76176 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.046161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 303/609] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:35.050005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c31bc-8595-4ca0-b134-ba70dde76176 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.052122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.076838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aacec-c8be-4bcc-a380-a872a10b6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.077764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aacec-c8be-4bcc-a380-a872a10b6b61 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.078040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aacec-c8be-4bcc-a380-a872a10b6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.078310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aacec-c8be-4bcc-a380-a872a10b6b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.082067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.087641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aacec-c8be-4bcc-a380-a872a10b6b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.089882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aacec-c8be-4bcc-a380-a872a10b6b61 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f46aacec-c8be-4bcc-a380-a872a10b6b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:35.107343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:35.108285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:35.109147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 307/610] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:35.113092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b85b0e-1133-4adb-9edc-ad2030c8d936 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.113092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b85b0e-1133-4adb-9edc-ad2030c8d936 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.113092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b85b0e-1133-4adb-9edc-ad2030c8d936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.135830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-29b85b0e-1133-4adb-9edc-ad2030c8d936 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:35.137136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-29b85b0e-1133-4adb-9edc-ad2030c8d936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:35.167852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c31bc-8595-4ca0-b134-ba70dde76176 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.203766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.204459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.204737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.205008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.216071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.217638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.225461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 308/611] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:35.226417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b85b0e-1133-4adb-9edc-ad2030c8d936 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:35.243523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:35.244520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:35.245417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:35.245417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:35.245417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:35.246794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 304/612] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:35.249306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.333453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.356664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3df46-d742-48de-a0f7-5d17688dbe25 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.357084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b85b0e-1133-4adb-9edc-ad2030c8d936 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.369638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.393202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.393988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.394363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.394709 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.395761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.396542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.396963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.397399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.398335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:35.398850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.400533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.409893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:35.413572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 309/613] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:35.414604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:35.415901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:35.417273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:35.418277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:35.419438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 305/614] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:35.425263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.534646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb801-b343-4dc4-8399-b0b84a67e2b7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.559850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb07a5-f083-43ab-8c1e-d8211c16ad8e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.569318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.570149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.570737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.571173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.571979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:35.572437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.574311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.593429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 310/615] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:35.593429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.603134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.604197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.604627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.605043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/64c5c41465004c0a81fced6e8834a5d0/roles/d8d8369da6884d00a8c296ddc1619fb6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.620036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.626211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.631642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=64c5c41465004c0a81fced6e8834a5d0, role_id=d8d8369da6884d00a8c296ddc1619fb6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.633129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.649336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 306/616] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:35 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/64c5c41465004c0a81fced6e8834a5d0/roles/d8d8369da6884d00a8c296ddc1619fb6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:35.650573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.711677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c7adb-47ce-47fa-9087-42e596099062 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.749851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.750748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.751262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.751711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.752562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:35.753011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.754707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.765006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 311/617] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:35.771649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c409ef7-6d5d-4248-8894-08fe64969b99 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.773499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.830274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.830856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.831142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.831412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:35.845899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:35.847389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:35.872165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:35.873164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:35.874221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:35.875370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 307/618] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:35.881868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:35.909738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.919046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142172d-0ac6-49b9-8e0f-f6d90e30fc10 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:35.962577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:35.987360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:35.988020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:35.988297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:35.988572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.006031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.007617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:36.022731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:36.023729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:36.025395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:36.025395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:36.025395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:36.025395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 312/619] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:36.030081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:36.057219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed203ed5-139f-487c-a200-b32a32a2a5e2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:36.092829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:36.093703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:36.093995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:36.094536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.095284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:36.095742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.097794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.118154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 308/620] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Aug 8 02:19:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:36.128225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:36.169662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b4dd3-7435-43db-92a6-fabfb210f61c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:36.239498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:36.240524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:36.240799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:36.241069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.241752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:36.242057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.243671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.267056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 313/621] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:36.277485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:36.280893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:36.319291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e147-f290-4b40-9845-efccfff80284 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:36.328307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:36.359463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:36.360019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:36.360301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:36.360574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.372705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.377083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:36.395668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:36.397937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:36.400024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:36.400024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:36.400024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:36.400024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 309/622] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:36.402824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:36.443664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91f5c4-8a35-407d-bac8-c4631eb21a54 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:36.481123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:36.481785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:36.482059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:36.482327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.500175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.501678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:36.527387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:36.529786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:36.531984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 314/623] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:36.538456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:36.547816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9c6aa-0a2c-4f22-9681-a772e580a5d0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:36.584476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:36.585088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:36.585384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:36.585668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.586455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:36.586761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.588150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.602462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 310/624] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:36.610488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:36.649739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:36.727692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:36.746273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe7e04-f12c-4bb0-a45d-14ea362769f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:36.786677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:36.788229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:36.788581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:36.789809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.804069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.806583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.817243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f5541-d130-46ab-9157-d2451ea24559 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:36.831294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:36.832441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:36.833554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:36.842266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 311/625] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:36.848082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:36.868647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:36.869616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:36.870045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:36.870488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:36.871519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:36.871968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:36.874907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:36.905207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 315/626] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:36.912526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.000924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.031979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efd21-badd-4938-a8e6-498ea36f3bc1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.074446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb7223-c22d-4aa5-9daa-78252c8285b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.075419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb7223-c22d-4aa5-9daa-78252c8285b1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.075697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb7223-c22d-4aa5-9daa-78252c8285b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.075971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb7223-c22d-4aa5-9daa-78252c8285b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.076690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb7223-c22d-4aa5-9daa-78252c8285b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:37.077001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb7223-c22d-4aa5-9daa-78252c8285b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:37.077357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6781c-d229-4155-9042-5ff7551efae1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.078646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb7223-c22d-4aa5-9daa-78252c8285b1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:37.093578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 312/627] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:37.099680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e59cf-cdb6-4d7c-93eb-61585f31c257 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.099994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e59cf-cdb6-4d7c-93eb-61585f31c257 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.100273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e59cf-cdb6-4d7c-93eb-61585f31c257 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.101667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 313/628] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:37.102415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.103646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e59cf-cdb6-4d7c-93eb-61585f31c257 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.117721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0070fe-16f4-4482-9321-d88b19bf4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.118476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0070fe-16f4-4482-9321-d88b19bf4507 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.118974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0070fe-16f4-4482-9321-d88b19bf4507 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.119208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0070fe-16f4-4482-9321-d88b19bf4507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.192145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0070fe-16f4-4482-9321-d88b19bf4507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:37.193635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0070fe-16f4-4482-9321-d88b19bf4507 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:37.210286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e59cf-cdb6-4d7c-93eb-61585f31c257 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.245861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cc7a1-7987-4936-b551-1581de37ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.246527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cc7a1-7987-4936-b551-1581de37ff97 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.246808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cc7a1-7987-4936-b551-1581de37ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.247495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cc7a1-7987-4936-b551-1581de37ff97 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/4a07806d34b143f186cfc63ea192d6c1/roles/d8d8369da6884d00a8c296ddc1619fb6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.258486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.265024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cc7a1-7987-4936-b551-1581de37ff97 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=4a07806d34b143f186cfc63ea192d6c1, role_id=d8d8369da6884d00a8c296ddc1619fb6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:37.266495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cc7a1-7987-4936-b551-1581de37ff97 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:37.280121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 314/629] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:37 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/4a07806d34b143f186cfc63ea192d6c1/roles/d8d8369da6884d00a8c296ddc1619fb6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:37.281423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a223-e377-4936-81ae-2418d2a2dbc6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.281719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a223-e377-4936-81ae-2418d2a2dbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.281992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a223-e377-4936-81ae-2418d2a2dbc6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.283379 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 315/630] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:37.288776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc2b0-2d2e-4c5b-aeb4-cce26fddd7c3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.289146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc2b0-2d2e-4c5b-aeb4-cce26fddd7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.289330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc2b0-2d2e-4c5b-aeb4-cce26fddd7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.313492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 316/631] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:37.313492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d6353-8cfd-40cc-b952-f228c758ff50 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.313492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d6353-8cfd-40cc-b952-f228c758ff50 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.313492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d6353-8cfd-40cc-b952-f228c758ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.316780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-320dc2b0-2d2e-4c5b-aeb4-cce26fddd7c3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:37.318542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-320dc2b0-2d2e-4c5b-aeb4-cce26fddd7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:37.331299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8d9d6353-8cfd-40cc-b952-f228c758ff50 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:37.332515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8d9d6353-8cfd-40cc-b952-f228c758ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:37.351428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.418979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 316/633] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:37.419157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 317/633] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:37.419993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d6353-8cfd-40cc-b952-f228c758ff50 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.461036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc2b0-2d2e-4c5b-aeb4-cce26fddd7c3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.533980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d6353-8cfd-40cc-b952-f228c758ff50 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.569504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.570149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.570427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.570854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.584464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:37.586362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:37.590617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc2b0-2d2e-4c5b-aeb4-cce26fddd7c3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:37.604674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:37.605700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:37.606569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:37.606569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:37.606569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:37.606569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 318/634] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:37.608056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.611110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.611586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.641500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.643095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.643791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.644206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.658810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:37.665047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:37.666158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:37.667825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:37.675962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 317/635] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:37.675962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.746523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91c56d-c625-4c23-a30f-6c2e84cec523 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.787271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.788433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.788878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.789538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.804481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:37.805934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750b70-40a4-40df-bed8-f91fe0ee62aa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:37.811944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:37.813083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:37.814097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:37.816794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 319/636] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:37.817757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.848054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.848847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.849226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.849735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.850355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:37.850752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:37.852214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:37.864359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 318/637] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:37.865415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:37.898988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.905936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.950818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f6bfe-b897-4438-9ee7-9e50903a8c42 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.974749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1c7b1-4853-412f-856d-a6188a249f5d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:37.991288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:37.991986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:37.992336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:37.992672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:37.993444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:37.993828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:37.995448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.004603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 320/638] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:38.005430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.023495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581e704-3ba5-40f1-9dd9-3c14a68f95f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.024204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e704-3ba5-40f1-9dd9-3c14a68f95f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.024555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e704-3ba5-40f1-9dd9-3c14a68f95f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.025111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e704-3ba5-40f1-9dd9-3c14a68f95f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.025650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581e704-3ba5-40f1-9dd9-3c14a68f95f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:38.025958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581e704-3ba5-40f1-9dd9-3c14a68f95f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.027336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581e704-3ba5-40f1-9dd9-3c14a68f95f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.040015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 319/639] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:38.040015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e21b-6f50-4deb-be67-cf7c72777b73 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.040015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e21b-6f50-4deb-be67-cf7c72777b73 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.040015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e21b-6f50-4deb-be67-cf7c72777b73 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.040015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 320/640] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:38.040015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e21b-6f50-4deb-be67-cf7c72777b73 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.119779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4627-39ac-40cf-aa60-4753b6195405 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.143928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.148844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.153489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e21b-6f50-4deb-be67-cf7c72777b73 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.155582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.156883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.156883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.156883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.163606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.165210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:38.176306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:38.177338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:38.178469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:38.182284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 321/641] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:38.183124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.191706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9088c7-cf52-4a89-8bd0-5a9b85041017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.192463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9088c7-cf52-4a89-8bd0-5a9b85041017 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.192842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9088c7-cf52-4a89-8bd0-5a9b85041017 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.193206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9088c7-cf52-4a89-8bd0-5a9b85041017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.204495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9088c7-cf52-4a89-8bd0-5a9b85041017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.206344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9088c7-cf52-4a89-8bd0-5a9b85041017 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1e9088c7-cf52-4a89-8bd0-5a9b85041017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:38.220712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:38.221952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:38.223045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:38.223045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:38.223045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:38.226876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 321/642] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:38.227486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7e97-c973-4936-8bac-3207b05faa06 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.227763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7e97-c973-4936-8bac-3207b05faa06 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.228030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7e97-c973-4936-8bac-3207b05faa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.246106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-531a7e97-c973-4936-8bac-3207b05faa06 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:38.247277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-531a7e97-c973-4936-8bac-3207b05faa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:38.291619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423775-8f82-4fd4-af52-bc833e64914a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.321219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 322/643] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:38.325750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.326382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.326660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.326930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.330655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7e97-c973-4936-8bac-3207b05faa06 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.337758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.339302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:38.353766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:38.354856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:38.355917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:38.355917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:38.355917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:38.355917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 322/644] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:38.356140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.395845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.422386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.444192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7e97-c973-4936-8bac-3207b05faa06 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.466859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394179-dadf-45cd-8199-1adb0099595b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.481096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.481858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.482204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.482545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.483339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:38.483715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.485277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.503359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 323/645] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:38.503359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.510068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.510763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.511118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.511455 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.512207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:38.512578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.514038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.526275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 323/646] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:38.527308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.607658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f960298-1392-45c8-b550-fc203acbec4c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.630847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.638465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e6072-5a3a-434a-8584-38bc8fae0f42 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.649630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.650390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.650694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.651009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.663650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:38.669035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:38.670105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 324/647] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:38.670914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.675600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.676448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.676745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.677161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.677546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.679242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:38.679627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.681149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.701429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 324/648] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:38.701429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.785589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609970d1-7fe8-4af8-8bf2-392eb3f9d92a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.801601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c908ef-0162-40ea-a115-0804d56bdd02 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:38.820789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.821474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.821682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.821957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.822749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e0097046a5f7407d84884097fcfc4ba3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:38.823047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.825077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.841690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 325/649] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/role_assignments?user.id=e0097046a5f7407d84884097fcfc4ba3&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:38.841690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.848555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:38.849332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:38.849707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:38.850050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:38.861570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:38.863168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:38.877136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:38.878334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:19:38.879463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:38.884731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 325/650] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:38.886507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:38.909411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.937350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:38.982516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c805-8b96-4c27-a813-4098e99dc930 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.031410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3f750-c6f5-4f6a-b047-d256580e94e7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.038046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.039031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.039504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.040019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.040972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:39.041572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.043350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.052669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 326/651] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:39.053839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.074339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.075350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.075629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.075903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.088225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.089866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:39.102414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:39.103381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:39.104476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 326/652] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:39.105045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.183720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8339-663c-405b-818d-bc4725876f4f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.200674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:39.219679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:39.230273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.230890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.231158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.231431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.231837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737eb3f-df71-4157-9a57-33b3c155ec0c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.232164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:39.232466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.234203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.257690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 327/653] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:39.258985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.271857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.272876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.273414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.274070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.286223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.288154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:39.304500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:39.305502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:39.306364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:39.306364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:39.306364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:39.306994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 327/654] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:39.309024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.388209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913714f-f55a-4197-88ca-8fe6306b7c59 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.418036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa776ff-ce04-4347-a8dc-abf89b9a4f8e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.430399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.431016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.431531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.431875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.433441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:39.433788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.435229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.446732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:39.456055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.456666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.456949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.457223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.460458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 328/655] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:39.461491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.508862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:39.535566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.537036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.570283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d0daf-8781-43e9-856e-946cd088e547 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.607315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60397d5b-a8cd-40bf-8736-7a0c5859e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.607930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60397d5b-a8cd-40bf-8736-7a0c5859e011 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.608206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60397d5b-a8cd-40bf-8736-7a0c5859e011 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.608473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60397d5b-a8cd-40bf-8736-7a0c5859e011 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.609111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60397d5b-a8cd-40bf-8736-7a0c5859e011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:39.609438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60397d5b-a8cd-40bf-8736-7a0c5859e011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.610807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60397d5b-a8cd-40bf-8736-7a0c5859e011 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.630055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 329/656] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:39.631287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15732f-a91d-4e6b-b9cf-a5881a8c18a5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.631571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15732f-a91d-4e6b-b9cf-a5881a8c18a5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.631840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15732f-a91d-4e6b-b9cf-a5881a8c18a5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.633193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 330/657] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:39.638503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15732f-a91d-4e6b-b9cf-a5881a8c18a5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.644203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 328/658] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:39.644985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.673666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:39.755123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b922-96e7-498f-8758-08a4193b43c6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.757138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15732f-a91d-4e6b-b9cf-a5881a8c18a5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:39.760623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:39.789791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48ae9f-980b-47f1-a641-07131aa028a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.790433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48ae9f-980b-47f1-a641-07131aa028a7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.790715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48ae9f-980b-47f1-a641-07131aa028a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.790991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48ae9f-980b-47f1-a641-07131aa028a7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.797801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:39.798623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.798930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48ae9f-980b-47f1-a641-07131aa028a7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.799260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.799725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.800455 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48ae9f-980b-47f1-a641-07131aa028a7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-dd48ae9f-980b-47f1-a641-07131aa028a7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:39.813157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:39.814292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:19:39.815331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:39.818882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 329/659] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:39.820038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfb214-4427-47ca-b460-4c53f71450d1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:39.820478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfb214-4427-47ca-b460-4c53f71450d1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:39.820702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfb214-4427-47ca-b460-4c53f71450d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:39.839767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-21cfb214-4427-47ca-b460-4c53f71450d1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:39.841102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-21cfb214-4427-47ca-b460-4c53f71450d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:39.874526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:39.876141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:39.914256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 330/660] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:39.917604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfb214-4427-47ca-b460-4c53f71450d1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:39.934650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.001271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 331/661] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:40.001271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.003567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.028970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfb214-4427-47ca-b460-4c53f71450d1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.067318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.067949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.068227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.068551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.079419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.080805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:40.096643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:40.097722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:40.098627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:40.098627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:40.098627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:40.098627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 331/662] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:40.098861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.123438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522604f-76f1-48b7-8e14-bf5aa419493a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.160089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.160685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.160963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.161236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.162010 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:40.162317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.163764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.172552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.186618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 332/663] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Aug 8 02:19:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:40.187653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.206187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6890-e9b0-459e-9f44-97c3d8349eb6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.240554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.241182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.241482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.241754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.252764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:40.256764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:40.257670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:40.258926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 332/664] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:40.259764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.303749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28c94-60fb-401a-86dc-65dcae2509e0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.339730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.340289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.340562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.340828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.351436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.353002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.361194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6304c5-a707-495b-ba19-9275fdde4e2e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:40.367770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:40.368686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:40.370391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:40.370391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:40.370391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:40.370391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 333/665] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:40.370391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.396289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.403152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.403760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.404034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.404301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.404942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:40.405238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.406657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.417943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 333/666] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:40.418764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.484071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985ea0d-f007-4aa3-ac9a-fead831df729 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.499078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.519192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683ff2-c29a-48d6-888f-95fd8b63c3a2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.521143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.521998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.522276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.522544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.552326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.552931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.553212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.553521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.554191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:40.554481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.555853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.563808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 334/667] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:40.564610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.598872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.600517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.628878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.679923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1e03-6ae9-4865-899b-3edbfe1abe7c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.714177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 334/668] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:40.715333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.719741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.720357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.720630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.720913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.721597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:40.721898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.723282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.734156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.740621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 335/669] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:40.740621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.823990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01feba-be29-4d6f-958a-e3f95c5fb0a2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.836256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba88e-c743-441f-a844-f7a2fae3a680 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:40.850088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.860753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.861421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.861703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.861976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.868638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.870319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.872148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:40.872795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:40.873076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:40.873349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:40.883140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:40.884323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:40.885250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:40.885694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:40.885768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 335/670] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:40.885768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.890400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:40.907626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:40.908581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:40.909474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:40.909474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:40.909474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:40.909474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 336/671] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:40.909693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:40.968049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.994659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8514254-eadc-41c2-b382-825ae506b359 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.014067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de073518-2cf2-48df-83a5-7486e7bc3cf9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.030971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.031600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.031875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.032140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.042302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.043741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.046495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.047123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.047405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.047680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.054288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.055718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:41.057962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:41.058881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:41.059810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:41.059810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:41.059810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:41.059810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 336/672] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:41.059810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:41.066905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:41.067851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:41.068689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 337/673] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:41.069829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.093900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.162930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a21f-6540-4d78-8ba8-91e1cc8bdd8c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.166096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cac7-27fe-49ed-8870-5c456cd0fb86 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.188644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.197542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d8dd2-2a10-47d5-a089-e50cc61e7949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.198146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d8dd2-2a10-47d5-a089-e50cc61e7949 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.198423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d8dd2-2a10-47d5-a089-e50cc61e7949 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.198690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d8dd2-2a10-47d5-a089-e50cc61e7949 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.198971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.199371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d8dd2-2a10-47d5-a089-e50cc61e7949 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:41.199578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.200012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d8dd2-2a10-47d5-a089-e50cc61e7949 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.200204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.200477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.201113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:41.201438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.201526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d8dd2-2a10-47d5-a089-e50cc61e7949 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.202800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.213344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 337/674] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:41.214591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a4f74-1298-4e20-8537-331e2e4933d0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.214845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a4f74-1298-4e20-8537-331e2e4933d0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.215123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a4f74-1298-4e20-8537-331e2e4933d0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.216531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 338/675] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:41.217321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 338/676] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:41.218040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.221190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a4f74-1298-4e20-8537-331e2e4933d0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.305579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.323087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7da798-0ae3-403a-afd2-249581fb14a2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.325050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a4f74-1298-4e20-8537-331e2e4933d0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.358050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b3d6b-1d86-4873-bdeb-01c5360c2d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.358648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b3d6b-1d86-4873-bdeb-01c5360c2d26 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.358923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b3d6b-1d86-4873-bdeb-01c5360c2d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.359026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.359210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b3d6b-1d86-4873-bdeb-01c5360c2d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.359604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.359835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b3d6b-1d86-4873-bdeb-01c5360c2d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:41.359943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.360132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.360223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b3d6b-1d86-4873-bdeb-01c5360c2d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.360806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:41.361106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.361498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b3d6b-1d86-4873-bdeb-01c5360c2d26 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.362560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.373470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 339/677] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:41.374805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622ff1-8f0a-4435-8933-1bae089cfa33 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.374925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 339/678] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:41.375044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622ff1-8f0a-4435-8933-1bae089cfa33 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.375118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622ff1-8f0a-4435-8933-1bae089cfa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.375391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.397597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3a622ff1-8f0a-4435-8933-1bae089cfa33 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:41.398818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3a622ff1-8f0a-4435-8933-1bae089cfa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:41.455736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.482301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 340/679] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:41.483132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a622ff1-8f0a-4435-8933-1bae089cfa33 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.491877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cfd97-51f2-48dc-9966-ddc36bced118 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.528376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.529013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.529295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.529598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.537342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.538836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:41.550204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:41.551135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 340/680] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:41.552048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.556379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.588547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a622ff1-8f0a-4435-8933-1bae089cfa33 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.624217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.624831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.625106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.625394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.626306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=2d691f1a09e14fc5a1858b1ac3bdd026) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:41.626403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.627829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.633821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 341/681] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/role_assignments?user.id=2d691f1a09e14fc5a1858b1ac3bdd026&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:41.634422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.673668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8730b0-83b9-4672-afb1-ea12d788c391 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.681033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.714641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.715274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.715556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.715823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.716572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=913aaeebb773479e8c4cb64bb588fa34) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:41.716886 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.718473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.737399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 341/682] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/role_assignments?user.id=913aaeebb773479e8c4cb64bb588fa34&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:41.737399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.769899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02070138-d6f6-45de-8cc2-e25fe0a8bdb4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.815593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.816254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.816530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.816801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.831945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:41.834559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:41.839863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:41.856192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:41.857268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:41.858505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 342/683] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:41.859103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.894100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cee2bb-0a32-4186-884c-8bb09ffae2b4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:41.940031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:41.940269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:41.940505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:41.940738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:41.956561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:41.963908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:41.964885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:41.965777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:41.966399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 342/684] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:41.968312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:41.990905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:41.994537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1ae9-cf31-4f36-96d4-aaad01b6a2b7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.035028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.035756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.036035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.036415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.037210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:42.037573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.039192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.075561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 343/685] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:42.075561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.087448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f579a-6f4c-4118-b6eb-4423a4c518de None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.115369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:42.125084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.125931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.126433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.126847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.127697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:42.128143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.129757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.147663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 343/686] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:42.148878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.200918 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7ef8-23ed-4a38-927f-c66181b7e64e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.236887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.237455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.237737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.238004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.238713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:42.239018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.240439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.250069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 344/687] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:42.250921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.275204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3c6c-9d26-42d9-9a41-7275632eaf51 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.276015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:42.318832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.319860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.320143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.320511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.363640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943bd6e-950a-42db-a257-1e778718cbbb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.393965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:42.404745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.405384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.405673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.406057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.406864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=64c5c41465004c0a81fced6e8834a5d0) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:42.407418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.409485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.411023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.412582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.417600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 345/688] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/role_assignments?user.id=64c5c41465004c0a81fced6e8834a5d0&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:42.418541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.600009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:42.616314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 344/689] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:42.624078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761a50e-a3db-4a9d-a4cc-93162c14250e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.628675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.665318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.666466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.667060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.667060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.679734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.681313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:42.702376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:42.703573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:42.704672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:42.704672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:42.704672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:42.706078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 346/690] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:42.712046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.755356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:42.759731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed64473-94cf-4be0-b486-9251339fcbaf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.797115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.798173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.798667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.799141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.810252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.812021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:42.828386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:42.829355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:42.830345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:42.830345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:42.830345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:42.836711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 345/691] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:42.838415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.845984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcaf04-9c9b-496e-a3c5-fee97bdb422e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.882294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.882843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:42.883336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:42.883456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:42.884008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:42.884416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:42.886371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:42.888946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:42.900287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 347/692] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:42.906053 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:42.946525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892541-f7bf-4edc-9204-d81feb3aea61 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:42.999182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:42.999898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:43.000269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:43.000612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:43.001909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:43.002283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:43.004197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:43.016074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:43.022296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 346/693] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:43.033484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:43.038136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6835a2b-af69-48bb-bb8b-01fbd3f3acb1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:43.101292 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:43.102365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:43.102840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:43.103295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:43.133472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:43.136023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:43.177982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:43.179890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:43.181781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 348/694] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:19:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:43.196282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:43.326138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2dc396-7d74-40a6-8dc2-221938e0f6c3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:43.326713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:43.425753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664fd90-5238-479c-ab9a-e49c4db0a970 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:43.442698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:43.443344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:43.443626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:43.443901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:43.461198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:43.461847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:43.462124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:43.462392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:43.463347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:43.463658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:43.465092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:43.466481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:43.467933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:43.484917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 349/695] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:19:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:43.491140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:43.492723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:43.494494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 347/696] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:43.498509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:43.498783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:43.605807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:43.678913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d736a-13e0-44f7-af59-57a69481fa30 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:43.682238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0ced3-df51-4f2e-928a-95741f0fbdb4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:43.708346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:43.745228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:43.745867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:43.746143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:43.746409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:43.747106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:43.747409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:43.748849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:43.751030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df45fd-9651-4298-95bf-d2027db96860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:43.751645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df45fd-9651-4298-95bf-d2027db96860 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:43.751919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df45fd-9651-4298-95bf-d2027db96860 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:43.752186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df45fd-9651-4298-95bf-d2027db96860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:43.783901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 348/697] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:43.786310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:43.889381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44208908-9706-47f8-acf9-c4c528c785e2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:43.918240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:43.933557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:43.933557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:43.933557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:43.933557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:43.934179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=4a07806d34b143f186cfc63ea192d6c1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:43.934179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:43.934179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:43.938133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 349/698] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:43 2022] GET /identity/v3/role_assignments?user.id=4a07806d34b143f186cfc63ea192d6c1&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:43.950149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df45fd-9651-4298-95bf-d2027db96860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:43.951622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df45fd-9651-4298-95bf-d2027db96860 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.126077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 350/699] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:44.131792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:44.256266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024898-cecf-4a0c-a52c-687180c7661e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:44.288534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4494-d03f-4021-a9c4-dc9f93f65df2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.288818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4494-d03f-4021-a9c4-dc9f93f65df2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.289087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4494-d03f-4021-a9c4-dc9f93f65df2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.290714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 351/700] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:44.292326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:44.293194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.293687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.294142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.296335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023e8c-16fd-4d2a-8dcc-e7a2f31be85c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.296576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023e8c-16fd-4d2a-8dcc-e7a2f31be85c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.296849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023e8c-16fd-4d2a-8dcc-e7a2f31be85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.306820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:44.308562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.318349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-66023e8c-16fd-4d2a-8dcc-e7a2f31be85c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:44.319526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66023e8c-16fd-4d2a-8dcc-e7a2f31be85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:44.324339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:44.325642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:44.326613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:44.326613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:44.326613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:44.328813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 350/701] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:44.329976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:44.335058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:44.375033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:44.411857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 352/702] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:19:44.438005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023e8c-16fd-4d2a-8dcc-e7a2f31be85c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:44.451622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826b5bd-cfdb-4d07-918d-6243a226680b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:44.491976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:44.492459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.492801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.493140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.493902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:44.495316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:44.496335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.511453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 351/703] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:44.516956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:44.564863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023e8c-16fd-4d2a-8dcc-e7a2f31be85c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:44.606389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d8f3e-f05a-4cb6-8587-8ac962af3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:44.607033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8f3e-f05a-4cb6-8587-8ac962af3f0f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.607308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8f3e-f05a-4cb6-8587-8ac962af3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.607573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8f3e-f05a-4cb6-8587-8ac962af3f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.621001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:44.625913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d8f3e-f05a-4cb6-8587-8ac962af3f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:44.628228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d8f3e-f05a-4cb6-8587-8ac962af3f0f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.629123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a399c-3d03-478f-b039-ce714fa498fa None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:44.631489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4a1d8f3e-f05a-4cb6-8587-8ac962af3f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:44.648872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:44.650089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:44.651123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:44.651123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:44.651123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:44.651123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 353/704] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:44.656820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a689-8031-4e67-95f8-99ca232ecb7a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.656820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a689-8031-4e67-95f8-99ca232ecb7a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.656820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a689-8031-4e67-95f8-99ca232ecb7a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.656820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 354/705] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:44.658236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a689-8031-4e67-95f8-99ca232ecb7a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:44.676388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ac14d-ad3c-43d1-a5ad-209d89903818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:44.677461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac14d-ad3c-43d1-a5ad-209d89903818 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.677953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac14d-ad3c-43d1-a5ad-209d89903818 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.678428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac14d-ad3c-43d1-a5ad-209d89903818 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.686253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ac14d-ad3c-43d1-a5ad-209d89903818 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:44.688029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ac14d-ad3c-43d1-a5ad-209d89903818 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a75ac14d-ad3c-43d1-a5ad-209d89903818 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:44.701417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:44.702363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:44.703260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:44.710097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 352/706] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:44.711678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8e623-1582-46dc-92ee-93bc3c679d21 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.712175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8e623-1582-46dc-92ee-93bc3c679d21 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.712637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8e623-1582-46dc-92ee-93bc3c679d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.731355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-70f8e623-1582-46dc-92ee-93bc3c679d21 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:44.732953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-70f8e623-1582-46dc-92ee-93bc3c679d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:44.768620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a689-8031-4e67-95f8-99ca232ecb7a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:44.809574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:44.809574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.809574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.809574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.809979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:44.809979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:44.809979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.810456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 353/707] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:44.811968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8e623-1582-46dc-92ee-93bc3c679d21 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:44.820720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 355/708] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:44.826680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:44.886240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:44.923129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:44.932547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4e73-ecbd-4ef7-951a-88315357663e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:44.940157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8e623-1582-46dc-92ee-93bc3c679d21 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:44.968974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db320fc7-d74e-4a8b-9ef2-7002f2bb5b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:44.969840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db320fc7-d74e-4a8b-9ef2-7002f2bb5b21 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.970251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db320fc7-d74e-4a8b-9ef2-7002f2bb5b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.970519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db320fc7-d74e-4a8b-9ef2-7002f2bb5b21 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.971157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db320fc7-d74e-4a8b-9ef2-7002f2bb5b21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:44.972592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db320fc7-d74e-4a8b-9ef2-7002f2bb5b21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.977836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:44.978491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:44.979435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:44.979767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:44.980475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:44.980782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:44.982257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:44.995541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 354/709] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:44.996185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:45.008884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 356/710] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:19:44 2022] POST /identity/v3/users => generated 254 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:19:45.008884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb503a-3e88-47fc-a6b5-5a60771fe525 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.008884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb503a-3e88-47fc-a6b5-5a60771fe525 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.008884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb503a-3e88-47fc-a6b5-5a60771fe525 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.008884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 357/711] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:45.009806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb503a-3e88-47fc-a6b5-5a60771fe525 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:45.124102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6857-73b5-4be1-939a-588eb0b13958 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:45.162372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb503a-3e88-47fc-a6b5-5a60771fe525 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:45.163742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15cd23-c8f9-431c-b478-d94669206fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:45.164514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15cd23-c8f9-431c-b478-d94669206fdc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.164909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15cd23-c8f9-431c-b478-d94669206fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.165441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15cd23-c8f9-431c-b478-d94669206fdc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.166788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15cd23-c8f9-431c-b478-d94669206fdc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:45.169641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15cd23-c8f9-431c-b478-d94669206fdc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:45.178786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5a15cd23-c8f9-431c-b478-d94669206fdc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:45.188727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:45.190030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:45.191107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 355/712] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Aug 8 02:19:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:45.191952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86593f9-21bd-491a-ace9-ec30e0254795 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.192026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86593f9-21bd-491a-ace9-ec30e0254795 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.192343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86593f9-21bd-491a-ace9-ec30e0254795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.212419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e86593f9-21bd-491a-ace9-ec30e0254795 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:45.214485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e86593f9-21bd-491a-ace9-ec30e0254795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:45.217720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:45.223632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:45.225565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.225841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.226110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.227507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e0097046a5f7407d84884097fcfc4ba3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:45.227507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:45.229576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:45.235526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 358/713] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:45 2022] GET /identity/v3/role_assignments?user.id=e0097046a5f7407d84884097fcfc4ba3&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:45.236156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:45.322470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 356/714] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:45.345765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86593f9-21bd-491a-ace9-ec30e0254795 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:45.370423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c19cf-b9b0-4d66-ba5d-c8e2ff56a6ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:45.417901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:45.419088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.419794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.420278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.421404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:45.422000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:45.423508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:45.429898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 359/715] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Aug 8 02:19:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:45.435899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:45.470863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86593f9-21bd-491a-ace9-ec30e0254795 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:45.484229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:45.512188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:45.513231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.513747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.514216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] PATH_INFO: `/v3/services/network` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.515030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:45.516608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:45.534802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:45.535868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:45.536670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:45.539564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 357/716] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:45 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:45.545169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:45.549461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:45.557430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822f9a-8bd9-4614-9a85-e048162f1274 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:45.626596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:45.627197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.627488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.628290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.628395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:45.628669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:45.630142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:45.644847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 360/717] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Aug 8 02:19:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:45.685686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545168-557a-44a9-90f3-4fa912e15d32 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:45.727439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e955d-a616-4c10-8ae4-1d5980e8fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:45.728069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e955d-a616-4c10-8ae4-1d5980e8fa0a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.728347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e955d-a616-4c10-8ae4-1d5980e8fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.728699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e955d-a616-4c10-8ae4-1d5980e8fa0a None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.730144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e955d-a616-4c10-8ae4-1d5980e8fa0a None admin] RBAC: Adding query filter params (name=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:45.730450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e955d-a616-4c10-8ae4-1d5980e8fa0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:45.731867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e955d-a616-4c10-8ae4-1d5980e8fa0a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:45.737601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 358/718] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:19:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:45.743037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:45.888726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689993ce-4baf-4511-b590-217bf24c8f79 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:45.891156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:45.928537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f33d-769d-4a3c-aad3-f78f4f7e1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:45.929478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f33d-769d-4a3c-aad3-f78f4f7e1356 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:45.929759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f33d-769d-4a3c-aad3-f78f4f7e1356 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:45.930035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f33d-769d-4a3c-aad3-f78f4f7e1356 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:45.930673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f33d-769d-4a3c-aad3-f78f4f7e1356 None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:45.931002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f33d-769d-4a3c-aad3-f78f4f7e1356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:45.933094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f33d-769d-4a3c-aad3-f78f4f7e1356 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:45.938126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 361/719] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:19:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:46.664620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc3af-4cea-4fb8-a9ec-e241a8d34ae7 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:46.665648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc3af-4cea-4fb8-a9ec-e241a8d34ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:46.666375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc3af-4cea-4fb8-a9ec-e241a8d34ae7 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:46.668490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 359/720] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:46.674098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62df52-0898-4e2a-9516-ddfef45bc75d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:46.674916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62df52-0898-4e2a-9516-ddfef45bc75d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:46.675402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62df52-0898-4e2a-9516-ddfef45bc75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:46.702117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2f62df52-0898-4e2a-9516-ddfef45bc75d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:46.703658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f62df52-0898-4e2a-9516-ddfef45bc75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:46.795666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 362/721] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:46.839524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecc3af-4cea-4fb8-a9ec-e241a8d34ae7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:46.911398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:46.951355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecc3af-4cea-4fb8-a9ec-e241a8d34ae7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:46.988091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:46.989083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:46.989603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:46.990073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.001557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:47.006545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:47.007473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:47.008307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:47.011602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 360/722] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:47.017413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62df52-0898-4e2a-9516-ddfef45bc75d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:47.145181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:47.150051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62df52-0898-4e2a-9516-ddfef45bc75d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:47.186401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:47.187361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:47.187848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:47.188317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.189225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:47.189745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:47.191332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:47.200923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 363/723] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:47.206371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:47.358323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66db538-c168-4ec6-ba7c-cbbeadbc2b10 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:47.399680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:47.408186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70922fd-1730-425c-a609-f2c3b931f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:47.408818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70922fd-1730-425c-a609-f2c3b931f929 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:47.409102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70922fd-1730-425c-a609-f2c3b931f929 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:47.409401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70922fd-1730-425c-a609-f2c3b931f929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.423050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70922fd-1730-425c-a609-f2c3b931f929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:47.424531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70922fd-1730-425c-a609-f2c3b931f929 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f70922fd-1730-425c-a609-f2c3b931f929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:47.447817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:47.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:47.450086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:47.450086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:47.450086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:47.450086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 361/724] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:47.455138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:47.699135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9124a54-672f-4481-9f9c-acbb7771ab50 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:47.699999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9124a54-672f-4481-9f9c-acbb7771ab50 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:47.699999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9124a54-672f-4481-9f9c-acbb7771ab50 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.702646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 362/725] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:47.706722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347003d5-4f7f-4867-8fb9-fbb33f2bf552 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:47.707240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347003d5-4f7f-4867-8fb9-fbb33f2bf552 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:47.707716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347003d5-4f7f-4867-8fb9-fbb33f2bf552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.739175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-347003d5-4f7f-4867-8fb9-fbb33f2bf552 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:47.740392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-347003d5-4f7f-4867-8fb9-fbb33f2bf552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:47.746114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffa6bf-7466-4e97-955d-b44e01e8b3af None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:47.801956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0271dd-1fbe-46b8-aaa1-5516d4e2da49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:47.802761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0271dd-1fbe-46b8-aaa1-5516d4e2da49 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:47.803018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0271dd-1fbe-46b8-aaa1-5516d4e2da49 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:47.803293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0271dd-1fbe-46b8-aaa1-5516d4e2da49 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.803949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0271dd-1fbe-46b8-aaa1-5516d4e2da49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:47.804252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0271dd-1fbe-46b8-aaa1-5516d4e2da49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:47.807131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0271dd-1fbe-46b8-aaa1-5516d4e2da49 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:47.821274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 364/726] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:47.823008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637328d-f4d7-42ad-9713-2caa80e36995 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:47.823497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637328d-f4d7-42ad-9713-2caa80e36995 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:47.823975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637328d-f4d7-42ad-9713-2caa80e36995 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.825984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 365/727] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:47.827253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637328d-f4d7-42ad-9713-2caa80e36995 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:47.852256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 363/728] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:47.854619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcbadc-f193-46bf-ad6e-8845d6adf852 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:47.854909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcbadc-f193-46bf-ad6e-8845d6adf852 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:47.855177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcbadc-f193-46bf-ad6e-8845d6adf852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:47.859313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:47.877516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-82bcbadc-f193-46bf-ad6e-8845d6adf852 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:47.879108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-82bcbadc-f193-46bf-ad6e-8845d6adf852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:47.963181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637328d-f4d7-42ad-9713-2caa80e36995 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:47.967022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 364/729] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:47.967916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcbadc-f193-46bf-ad6e-8845d6adf852 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.012820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.014047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.014683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.015137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.023386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.024235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.026094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:48.040429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:48.041554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:48.042469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:48.049783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 366/730] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:48.050914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.086525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcbadc-f193-46bf-ad6e-8845d6adf852 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.123270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.124009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.124364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.124706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.136410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:48.139831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:48.142720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:48.150115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 365/731] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:48.151397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.168710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9dcea-a047-4387-97ab-dff5baadb0b9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.206241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.207366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.207813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.208246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.219979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:48.225092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:48.226247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:48.227179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:48.229554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 367/732] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:48.230563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.255388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.258513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505254f5-2636-4cac-a21e-c4294c78a868 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.297323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.298166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.298456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.298736 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.299531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:48.299840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.301435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.325339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 366/733] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:48.325339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.346916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cd88-2b2b-482d-b8a4-bdf808f99e4c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.383181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.383805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.384105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.384347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.385071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:48.385395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.386769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.395056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 368/734] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:48.395859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.398592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.439735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8daddd-f5b5-4870-b0f2-f272a923bc50 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.484759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117f29d-eb40-4f78-ba28-f915655e0e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.485698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117f29d-eb40-4f78-ba28-f915655e0e39 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.486584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117f29d-eb40-4f78-ba28-f915655e0e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.487042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117f29d-eb40-4f78-ba28-f915655e0e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.488163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117f29d-eb40-4f78-ba28-f915655e0e39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:48.488798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117f29d-eb40-4f78-ba28-f915655e0e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.490984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117f29d-eb40-4f78-ba28-f915655e0e39 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.498840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645c8f-edb4-4bd6-89a6-c6518cbab383 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.504594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 367/735] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:48.504594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637f500-9c41-4770-9c65-2f742159a8a1 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.504594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637f500-9c41-4770-9c65-2f742159a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.504594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637f500-9c41-4770-9c65-2f742159a8a1 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.504594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 368/736] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:48.504594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637f500-9c41-4770-9c65-2f742159a8a1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.532999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.539106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ca94d-8917-4723-b60c-33caef54b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.539727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ca94d-8917-4723-b60c-33caef54b331 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.540241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ca94d-8917-4723-b60c-33caef54b331 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.540241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ca94d-8917-4723-b60c-33caef54b331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.607043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ca94d-8917-4723-b60c-33caef54b331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.608505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ca94d-8917-4723-b60c-33caef54b331 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.610338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.616285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637f500-9c41-4770-9c65-2f742159a8a1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.649064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.649735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.650003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.650381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.660574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.662083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:48.677163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:48.678116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:48.679006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:48.679006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:48.679006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:48.679006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 369/737] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:48.679236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.714106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 369/738] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:48.714106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac03b-5480-4770-9ab6-e1c52faf7141 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.714106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac03b-5480-4770-9ab6-e1c52faf7141 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.714106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac03b-5480-4770-9ab6-e1c52faf7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.728377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-564ac03b-5480-4770-9ab6-e1c52faf7141 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:48.729698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-564ac03b-5480-4770-9ab6-e1c52faf7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:48.747788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.777806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc96e86-7f74-47be-81bb-c8d9d171e1d8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.794530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 370/739] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:48.795850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eba25-0501-4ff6-bd32-b3e79715cec7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.796128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eba25-0501-4ff6-bd32-b3e79715cec7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.796393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eba25-0501-4ff6-bd32-b3e79715cec7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.797820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 371/740] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:48.802313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eba25-0501-4ff6-bd32-b3e79715cec7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.810053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.810684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.810961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.811232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.822329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.824167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:48.838499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:48.839516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:48.840380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:48.840380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:48.840380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:48.841329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.842132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 370/741] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:48.842771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:48.912248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eba25-0501-4ff6-bd32-b3e79715cec7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.938531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67249e2-c32a-4ce5-be91-f2f657f872cf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:48.945385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbdffd-2a9b-4308-87a3-f9fd2dc2fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.945990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdffd-2a9b-4308-87a3-f9fd2dc2fea8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.946263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdffd-2a9b-4308-87a3-f9fd2dc2fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.946530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdffd-2a9b-4308-87a3-f9fd2dc2fea8 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.947204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbdffd-2a9b-4308-87a3-f9fd2dc2fea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:48.947508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbdffd-2a9b-4308-87a3-f9fd2dc2fea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.948913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbdffd-2a9b-4308-87a3-f9fd2dc2fea8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:48.960197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 372/742] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:48.961358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecf9a-f5ea-4345-994f-4646f0edb795 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.961719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecf9a-f5ea-4345-994f-4646f0edb795 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.961991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecf9a-f5ea-4345-994f-4646f0edb795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.966317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:48.976790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:48.977441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:48.977715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:48.977980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:48.979724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b1eecf9a-f5ea-4345-994f-4646f0edb795 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:48.980879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b1eecf9a-f5ea-4345-994f-4646f0edb795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:48.988691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:48.990138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:49.003580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:49.004488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:49.005403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:49.005403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:49.005403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:49.005403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 371/743] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:49.005403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.047885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 373/744] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:19:49.048810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eecf9a-f5ea-4345-994f-4646f0edb795 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.072016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:49.118001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365f066-fbc5-40e3-a6d5-d9869326a3f8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.150908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eecf9a-f5ea-4345-994f-4646f0edb795 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.153177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.153818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.154103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.154380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.155026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.156415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.173587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 372/745] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:19:49 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:49.174518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.209567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.210322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.210658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.210989 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.211707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:49.212070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.213947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.218148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:49.232121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 374/746] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:49.232121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.301737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285c70e-f451-4d87-870f-f52474185273 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.321229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:49.341533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.342294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.343095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.343095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.346976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4616-4a3f-493a-b0d5-55939e4eda84 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.350317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.352001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:49.365622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:49.366784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 373/747] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:49.368888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.391376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.391994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.392273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.392544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.393187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:49.393527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.394901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.407161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 375/748] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:49.407806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.484698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:49.492857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff293-87fe-4b58-91ae-ba82d52590dd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.511425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dd63a-8900-4682-b927-3fc9f27ddd27 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.530486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.531267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.531554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.531858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.532511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.533945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.546706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.547570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.547978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.548374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.561696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 374/749] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:19:49 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:49.561696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.568597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.570399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.572730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:49.584163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:49.585286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:19:49.586440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:49.591716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 376/750] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:49.592720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.713754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644d6a1-68e5-4824-a9bd-bd7baf437add None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.726802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01cecf-7cc0-4a5b-abc4-7562331c6132 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.752285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.753661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.754168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.754640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.755389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:49.755697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.757170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.766694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.767343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.767621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.767895 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.775639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.777143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.777355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 375/751] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:49.778476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:49.790985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:49.791967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:49.792874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 377/752] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:49.793405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.797395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:49.870358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:49.890638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed01d75-c3ad-4c22-9f31-5f7900624dd9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.924867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede67bf6-48f5-4de0-ba49-fe115522224a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:49.928584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.929452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.929901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.930320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.931296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:49.931780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.933420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.952857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 376/753] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:49.954080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:49.962477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:49.963209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:49.963540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:49.963929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:49.975561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:49.976996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:49.992586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:49.993880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:49.994898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:49.994898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:49.994898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:49.995111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 378/754] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:49.997725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.032236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.068294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ed19-93da-4105-8384-b53f093bcb7b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:50.107724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:50.108143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dd408-a168-477d-bc1c-4fa285bb2040 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:50.109036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.109532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.109995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.110906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:50.111417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:50.113101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:50.119683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.132357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 377/755] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:50.133565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.147723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:50.148340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.148618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.148889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.230072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:50.231954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:50.253430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f16a-d186-4d54-a0b3-69d61ea4ba94 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:50.290592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.301138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:50.302041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.302323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.302600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.303656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:50.303965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:50.305660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:50.321540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 378/756] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:50.322848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.355939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 379/757] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:50.357290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.373246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.468337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbb2d7-34b3-49e8-b380-ea24dcfc3a65 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:50.471184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462aed7-b7f2-40b6-894b-ade954b463aa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:50.504336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:50.504951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.505293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.505620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.506357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=4a07806d34b143f186cfc63ea192d6c1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:50.506671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:50.508116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:50.508655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:50.509616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.510174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.510647 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.520133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 379/758] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:50 2022] GET /identity/v3/role_assignments?user.id=4a07806d34b143f186cfc63ea192d6c1&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:50.520133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.524114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:50.533731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:50.551510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:50.552454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:50.553430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:50.569646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 380/759] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:50.570685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.605938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.701195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7ef63-8067-45db-91cd-b7fdbaaaef49 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:50.719970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.758064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:50.759419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.761794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.762279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.786872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4a99-6922-4567-bba4-a54416e1a28e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:50.788018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:50.789806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:50.818641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:50.819625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:50.820476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:50.820476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:50.820476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:50.823331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 380/760] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:50.828769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.844594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:50.845609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.846081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.846555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.847485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:50.847977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:50.849668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:50.863573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 381/761] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:50.870417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.022227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27dd60-3523-4b2d-8657-ef9f380b9168 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.033866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:51.055414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f82eb1-2a08-4344-8af5-756ab8711c2a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.088442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.093624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.093624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.093624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.093624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:51.093624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.093624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.095586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:51.105017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b59a9-e390-44b5-a0dc-6b9e8387c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.105960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b59a9-e390-44b5-a0dc-6b9e8387c342 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.106828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b59a9-e390-44b5-a0dc-6b9e8387c342 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.107351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b59a9-e390-44b5-a0dc-6b9e8387c342 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e0097046a5f7407d84884097fcfc4ba3/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.111807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b59a9-e390-44b5-a0dc-6b9e8387c342 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=e0097046a5f7407d84884097fcfc4ba3, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.113271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b59a9-e390-44b5-a0dc-6b9e8387c342 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.119848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 381/762] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:51.125727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.143235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 382/763] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:50 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e0097046a5f7407d84884097fcfc4ba3/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:51.278220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255156-b396-4e79-9d31-1d21316a6d03 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.278397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255156-b396-4e79-9d31-1d21316a6d03 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.278679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255156-b396-4e79-9d31-1d21316a6d03 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.279074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee12d8-8418-43fe-9e49-317fdd92ed6a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.280405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 383/764] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:51.285966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff142-0d3c-401b-bf56-3348f2b43b9a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.286275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff142-0d3c-401b-bf56-3348f2b43b9a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.286515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff142-0d3c-401b-bf56-3348f2b43b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.305589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-21cff142-0d3c-401b-bf56-3348f2b43b9a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:51.307054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21cff142-0d3c-401b-bf56-3348f2b43b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:51.334388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.335032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.335316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.335600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.342891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.344374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:51.356785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:51.357956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:51.359244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 382/765] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:51.364070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.402179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 384/766] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:19:51.409631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:51.425752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cff142-0d3c-401b-bf56-3348f2b43b9a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.512741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066a65e-b1ac-47e5-9d79-a10809d6f376 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.541421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cff142-0d3c-401b-bf56-3348f2b43b9a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.551785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.552393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.552680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.552961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.553885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:51.554105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.555618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.564192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:51.570693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 383/767] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:51.578229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.579745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.580396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.580701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.580947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.581593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.582999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:51.602998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:51.604321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:51.605412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 385/768] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:51.615625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.680706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:51.699923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25f69-d92f-44eb-849a-69c699e36ff2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.739003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8709da-78a9-4b03-b8de-78f69c6414c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.739993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8709da-78a9-4b03-b8de-78f69c6414c0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.740477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8709da-78a9-4b03-b8de-78f69c6414c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.740949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8709da-78a9-4b03-b8de-78f69c6414c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.741941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8709da-78a9-4b03-b8de-78f69c6414c0 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e91b89f02b6a4283bd61897eaefd47ad) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:51.742459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8709da-78a9-4b03-b8de-78f69c6414c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.744426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8709da-78a9-4b03-b8de-78f69c6414c0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.751178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 384/769] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/role_assignments?user.id=e91b89f02b6a4283bd61897eaefd47ad&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:51.756738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f4af-a687-48ca-979e-769092b6d997 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.757309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f4af-a687-48ca-979e-769092b6d997 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.757813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f4af-a687-48ca-979e-769092b6d997 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.759711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 385/770] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:51.764958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8521-f2fc-465f-bd01-4462677b949b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.765628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8521-f2fc-465f-bd01-4462677b949b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.766179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8521-f2fc-465f-bd01-4462677b949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.770854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0472a8-c9bd-4722-be4a-60391d154802 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.798509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a0eb8521-f2fc-465f-bd01-4462677b949b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:51.800092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a0eb8521-f2fc-465f-bd01-4462677b949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:51.805906 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.806589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.806870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.807138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.807774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:51.808077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.815677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.817499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 386/771] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:51.820560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.873889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:51.928348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc0c46-3c07-4d6b-a7a6-e01fad5b5089 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.937289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 386/772] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:19:51.966065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.966691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.966965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.967231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.967870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:51.968168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.969571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.971449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8521-f2fc-465f-bd01-4462677b949b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:51.979250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 387/773] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:51.984207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:52.088873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee5ed1-ab03-4de4-a502-e73a80a70166 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:52.102695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:52.118158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:52.124778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:52.125447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:52.126208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:52.126759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:52.128519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] RBAC: Adding query filter params (interface=public, service_id=b0b1703d8b42481eb7cffb7d655819c0, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:52.129076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:52.135505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:52.152739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8521-f2fc-465f-bd01-4462677b949b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:52.154683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 388/774] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/endpoints?service_id=b0b1703d8b42481eb7cffb7d655819c0&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:52.157505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:52.197816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:52.198466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:52.198743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:52.199065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] PATH_INFO: `/v3/services/network` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:52.200060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:52.202114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:52.219156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:52.220182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:52.221006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:52.221766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 387/775] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:51 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:52.227216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:52.319897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c7e04-e0bf-4d85-a0e7-e88133309517 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:52.355343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:52.355875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:52.356190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:52.356466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:52.357068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:52.358687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:52.361586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1895d-7f62-4b4f-9378-54c22407f077 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:52.364695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 389/776] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:19:52 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:52.403962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:52.404910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:52.405336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:52.405782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:52.406567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] RBAC: Adding query filter params (name=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:52.407029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:52.408586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:52.414544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 388/777] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:19:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:52.422903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:52.521882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:52.644636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e89977-00d6-44a4-ad4d-c157fa58a658 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:52.680966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:52.681681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:52.681964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:52.682237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:52.682879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:52.683184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:52.684569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:52.689951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 390/778] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:19:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:52.696034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:52.706261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:52.808106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bad76-90f5-4912-954b-edec560f1646 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:52.848542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49cce7-1994-48bc-a523-68a3514f0e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:52.849165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49cce7-1994-48bc-a523-68a3514f0e10 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:52.849479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49cce7-1994-48bc-a523-68a3514f0e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:52.849761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49cce7-1994-48bc-a523-68a3514f0e10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:52.850472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49cce7-1994-48bc-a523-68a3514f0e10 None admin] RBAC: Adding query filter params (interface=public, service_id=2ca11bdb019e43528ea0acf17001a198, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:52.850785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49cce7-1994-48bc-a523-68a3514f0e10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:52.852176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49cce7-1994-48bc-a523-68a3514f0e10 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:52.865479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 389/779] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:19:52 2022] GET /identity/v3/endpoints?service_id=2ca11bdb019e43528ea0acf17001a198&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:52.871340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:52.986544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e47bb-1b07-4523-85c1-e508c02d3f5e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:52.988879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:53.028780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b77a1-bf1a-430b-bb16-ed7ce6a3f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:53.029425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b77a1-bf1a-430b-bb16-ed7ce6a3f5ff None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.029707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b77a1-bf1a-430b-bb16-ed7ce6a3f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.029975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b77a1-bf1a-430b-bb16-ed7ce6a3f5ff None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.030587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b77a1-bf1a-430b-bb16-ed7ce6a3f5ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:53.031953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b77a1-bf1a-430b-bb16-ed7ce6a3f5ff None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:53.042142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 391/780] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:19:52 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:53.060075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220ea3-82cb-4dfb-8246-c5b4198eaca0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.060711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220ea3-82cb-4dfb-8246-c5b4198eaca0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.061203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220ea3-82cb-4dfb-8246-c5b4198eaca0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.064419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 390/781] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:53.069358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ab59-7ae1-456d-b192-6af303027efc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.069979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ab59-7ae1-456d-b192-6af303027efc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.070447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ab59-7ae1-456d-b192-6af303027efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.097861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2501ab59-7ae1-456d-b192-6af303027efc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:53.099413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2501ab59-7ae1-456d-b192-6af303027efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:53.179748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 392/782] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:19:53.214528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2220ea3-82cb-4dfb-8246-c5b4198eaca0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:53.304164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:53.339024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2220ea3-82cb-4dfb-8246-c5b4198eaca0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:53.373355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:53.374088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.374363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.374631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.386812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:53.391717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:53.392685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:53.393549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:53.395662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 391/783] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:53.401317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ab59-7ae1-456d-b192-6af303027efc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:53.530333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:53.534458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ab59-7ae1-456d-b192-6af303027efc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:53.572188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed5a5f-8be6-4993-9c51-4f1a6877f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:53.572800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed5a5f-8be6-4993-9c51-4f1a6877f84d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.573134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed5a5f-8be6-4993-9c51-4f1a6877f84d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.573425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed5a5f-8be6-4993-9c51-4f1a6877f84d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.574098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed5a5f-8be6-4993-9c51-4f1a6877f84d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:53.574395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed5a5f-8be6-4993-9c51-4f1a6877f84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:53.576099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed5a5f-8be6-4993-9c51-4f1a6877f84d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:53.589135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 393/784] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:53.594970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:53.667015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64373-e4ac-4a17-a0c6-4b95cb61d920 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.667386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64373-e4ac-4a17-a0c6-4b95cb61d920 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.667566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64373-e4ac-4a17-a0c6-4b95cb61d920 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.669207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 394/785] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:53.679726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4c05-630a-4715-a158-885a15bcb767 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.680014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4c05-630a-4715-a158-885a15bcb767 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.680292 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4c05-630a-4715-a158-885a15bcb767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.709759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca415d8-c06e-461e-ac00-5588c3054835 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:53.720463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a4ff4c05-630a-4715-a158-885a15bcb767 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:53.723259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a4ff4c05-630a-4715-a158-885a15bcb767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:53.764733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:53.775481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:53.776251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.776541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.776829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.793829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:53.795315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:53.812405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:53.814072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:53.815142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:53.815142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:53.815142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:53.815142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 392/786] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:53.815550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 395/787] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:19:53.819494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:53.889996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff4c05-630a-4715-a158-885a15bcb767 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:53.967284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50e3a-fe79-4f48-9a7b-87aa5e3c9b5a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.038950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.039630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.039918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.040194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.040921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:54.041224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.044409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.066991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:54.069690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 393/788] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:54.074351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.087400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff4c05-630a-4715-a158-885a15bcb767 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.141878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:54.166614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.167276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.167561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.167841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.194321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:54.195585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a16e08-52f7-4d01-bade-52c513f1c857 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:54.199810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:54.200743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:54.201991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 396/789] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:54.212268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.237728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.238366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.238692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.238968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.246621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.248266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:54.260808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:54.261791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:54.263365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 394/790] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:54.278900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.374434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da5155-ef1e-4e6e-b4ee-9e7e81c52b0b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.421975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.422990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.423489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.423962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.425346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:54.425875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.427981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.438074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 397/791] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:54.443363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.473763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:54.475489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef697-af8a-474e-af1a-1ecb89519d38 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.477905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:54.537480 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dd7ad-4245-438c-9a30-c2ddc825e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.538115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd7ad-4245-438c-9a30-c2ddc825e4cd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.538893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd7ad-4245-438c-9a30-c2ddc825e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.539187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd7ad-4245-438c-9a30-c2ddc825e4cd None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.540310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dd7ad-4245-438c-9a30-c2ddc825e4cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:54.540680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dd7ad-4245-438c-9a30-c2ddc825e4cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.542789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dd7ad-4245-438c-9a30-c2ddc825e4cd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.565924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 395/792] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:54.567214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed8867-f413-43ca-ab33-e1b14e130369 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.567501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed8867-f413-43ca-ab33-e1b14e130369 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.567777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed8867-f413-43ca-ab33-e1b14e130369 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.573928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 396/793] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:54.577805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed8867-f413-43ca-ab33-e1b14e130369 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.601946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4ee74-b1a0-4e13-842d-241825a8090a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.646307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d059558-87cf-4e84-b5fd-3f5ac358b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.646748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d059558-87cf-4e84-b5fd-3f5ac358b961 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.647031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d059558-87cf-4e84-b5fd-3f5ac358b961 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.647347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d059558-87cf-4e84-b5fd-3f5ac358b961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.659365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d059558-87cf-4e84-b5fd-3f5ac358b961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.661226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d059558-87cf-4e84-b5fd-3f5ac358b961 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7d059558-87cf-4e84-b5fd-3f5ac358b961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:54.676876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:54.677862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:54.678735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:54.678735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:54.678735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:54.678735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 398/794] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:54.679616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c24a-3ea1-4133-9e6a-cf8a2578d380 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.679902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c24a-3ea1-4133-9e6a-cf8a2578d380 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.680169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c24a-3ea1-4133-9e6a-cf8a2578d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.700278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed8867-f413-43ca-ab33-e1b14e130369 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.700475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0e38c24a-3ea1-4133-9e6a-cf8a2578d380 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:54.701619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0e38c24a-3ea1-4133-9e6a-cf8a2578d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:54.736202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.737208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.737708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.738170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.749012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.750815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:54.765702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:54.766615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:54.767470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:54.767470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:54.767470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:54.767633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:54.773942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 397/795] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:54.775259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.784440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 399/796] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:19:54.785503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38c24a-3ea1-4133-9e6a-cf8a2578d380 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.791278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:54.877740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99af6-fe81-4559-a990-a9ea58b06749 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.911940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38c24a-3ea1-4133-9e6a-cf8a2578d380 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:54.913072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.913945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.914428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.914888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.915798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:54.916564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.918172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.930475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 398/797] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:54.931712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:54.950042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:54.950815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:54.951098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:54.951371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:54.952260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:54.952470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:54.953974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:54.967257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 400/798] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:54.968339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.006810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.032310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.037515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f690-bf30-417d-9752-6099cd23a473 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.073141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.073806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.074082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.074736 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.080717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db8df-6d3b-4d62-8732-377d26ee14e2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.084906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:55.090916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:55.091853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:55.092665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 399/799] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:55.093471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.124361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5bc68-616a-4ba0-ba44-8ee6ca6ddc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.125584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5bc68-616a-4ba0-ba44-8ee6ca6ddc3a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.126341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5bc68-616a-4ba0-ba44-8ee6ca6ddc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.127045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5bc68-616a-4ba0-ba44-8ee6ca6ddc3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.137373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5bc68-616a-4ba0-ba44-8ee6ca6ddc3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.139583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5bc68-616a-4ba0-ba44-8ee6ca6ddc3a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d7c5bc68-616a-4ba0-ba44-8ee6ca6ddc3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:55.154621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:55.155705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:19:55.156779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:55.163399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 401/800] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:19:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:55.163399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b227bf-73ec-43c6-a080-d45e18e726ca None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.163822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b227bf-73ec-43c6-a080-d45e18e726ca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.164099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b227bf-73ec-43c6-a080-d45e18e726ca None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.166502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 402/801] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:55.170656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b227bf-73ec-43c6-a080-d45e18e726ca None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.195771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84701b-ef79-4c06-b230-046a64a95907 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.226546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.234939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.235770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.236200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.236488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.243982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.245492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:55.256620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:55.258041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 400/802] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:55.259266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.282297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b227bf-73ec-43c6-a080-d45e18e726ca None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.296642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.319763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e041c6-f516-47a2-bb89-b4cd6d721e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.320393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e041c6-f516-47a2-bb89-b4cd6d721e5a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.320726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e041c6-f516-47a2-bb89-b4cd6d721e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.321008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e041c6-f516-47a2-bb89-b4cd6d721e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.321745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e041c6-f516-47a2-bb89-b4cd6d721e5a None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:55.322120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e041c6-f516-47a2-bb89-b4cd6d721e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.323544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e041c6-f516-47a2-bb89-b4cd6d721e5a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.333131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 403/803] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:55.334374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50a470-6096-4a60-b4bb-5485c336ef0e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.334658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50a470-6096-4a60-b4bb-5485c336ef0e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.334928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50a470-6096-4a60-b4bb-5485c336ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.354058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4e50a470-6096-4a60-b4bb-5485c336ef0e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:55.355282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e50a470-6096-4a60-b4bb-5485c336ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:55.375166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c487b64-0911-4fb2-985c-cb426d92a970 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.410416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.411427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.411997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.412274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.413012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:55.413316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.415008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.423202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 404/804] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:19:55.424054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50a470-6096-4a60-b4bb-5485c336ef0e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.438406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 401/805] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:55.438406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.485947 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.527323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50a470-6096-4a60-b4bb-5485c336ef0e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.535101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc8e29-43d2-4406-91bf-707eddf4498a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.535259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.562354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10cb05-432d-4c97-8e2e-0126c9e3609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.562976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10cb05-432d-4c97-8e2e-0126c9e3609c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.563255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10cb05-432d-4c97-8e2e-0126c9e3609c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.563524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10cb05-432d-4c97-8e2e-0126c9e3609c None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.564221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10cb05-432d-4c97-8e2e-0126c9e3609c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:55.564526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10cb05-432d-4c97-8e2e-0126c9e3609c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.566098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10cb05-432d-4c97-8e2e-0126c9e3609c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.570279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.570903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.571182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.571453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.578655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 405/806] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:55.579865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5199-1c6e-48ed-a467-d50c95a3837b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.580162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5199-1c6e-48ed-a467-d50c95a3837b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.580456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5199-1c6e-48ed-a467-d50c95a3837b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.581656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 406/807] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:55.582344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af5199-1c6e-48ed-a467-d50c95a3837b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.586136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.587721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:55.602948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:55.603924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:55.604770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:55.604770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:55.604770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:55.604770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 402/808] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:55.605006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.689785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af5199-1c6e-48ed-a467-d50c95a3837b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.725975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf7e6-d855-4ba0-82c6-f6c0d1e0330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.726596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf7e6-d855-4ba0-82c6-f6c0d1e0330e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.726882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf7e6-d855-4ba0-82c6-f6c0d1e0330e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.727154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf7e6-d855-4ba0-82c6-f6c0d1e0330e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.733514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc36fe-2956-44fd-b0a7-93c54f3ab000 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.735040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.762334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.767707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.768348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.768621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.768895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.769514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.770891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:55.779353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:55.780539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:55.781341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 403/809] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:55.782442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.803025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf7e6-d855-4ba0-82c6-f6c0d1e0330e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.804482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf7e6-d855-4ba0-82c6-f6c0d1e0330e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.881000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f5152-c939-4062-b6d0-6e47fdf7efc0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:55.900390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 407/810] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:55.901663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3038-144b-4a98-9782-0222de92c9c5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.901947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3038-144b-4a98-9782-0222de92c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.902211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3038-144b-4a98-9782-0222de92c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.914889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:55.915529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.915888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.916205 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/4a07806d34b143f186cfc63ea192d6c1/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.918299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=4a07806d34b143f186cfc63ea192d6c1, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:55.919743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:55.920384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-39ee3038-144b-4a98-9782-0222de92c9c5 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:55.921592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-39ee3038-144b-4a98-9782-0222de92c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:55.934259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 404/811] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:55 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/4a07806d34b143f186cfc63ea192d6c1/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:55.935068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.967603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:55.999073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.013505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 408/812] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:19:56.013505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee3038-144b-4a98-9782-0222de92c9c5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.083967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae278144-9d12-4265-9117-da9eb32dd24a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.124995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.125329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.125678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.125959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.126611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:56.126917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.128304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.130759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee3038-144b-4a98-9782-0222de92c9c5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.145453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 405/813] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:56.145453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.170191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.170830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.171114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.171374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.171997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:56.172289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.173701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.181411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 409/814] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:56.181411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.243281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.249104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.260769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c7092-c8f5-4f01-a255-46f5990808de None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.294930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.295489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.295768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.296038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.297162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817699-208d-4a44-982b-a5324ee096d1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.306437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.307901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:56.323572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:56.324875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:56.325766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:56.325766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:56.325766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:56.329700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 406/815] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:56.330533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.336482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.337127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.337504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.338389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.338988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.340359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:56.349409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:56.350399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:56.351250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 410/816] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:56.352021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.444481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cda03-3f7a-4d22-8346-77a4ab2e4e4d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.463130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa375-be45-459a-a8a0-ea11b28acaf9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.479611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.480251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.480537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.480815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.487291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.488471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.490097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.492104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.499971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.500586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.500865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.501133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.501813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:56.502117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.503470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:56.504430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:56.505496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 407/817] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:56.506422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.514966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 411/818] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:56.515722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.612924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1a95d-5e8c-43f4-be35-13906b58b962 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.629004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3d363-373b-4fa4-b422-f83f83f5b0c5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.652395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.653150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.653559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.653834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.654474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:56.654777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.656154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.664166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.664971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.665252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.665659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.666294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] RBAC: Adding query filter params (name=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:56.666599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.667960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.668602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 408/819] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:56.669275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.681660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 412/820] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:56.681660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.732361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.732880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.779249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff50e0-f677-4ccc-95ab-8fc0600d84db None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.783344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b3dc1-0df4-489f-8b41-dbc3db5fb861 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.813120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.813960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.814392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.814660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.815399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:56.815706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.817149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.822037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.822744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.823113 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.823472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.824234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.826037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.835031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 409/821] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:56.840595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.857402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 413/822] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:19:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:56.857402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:56.975717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fd6c0-0b9a-47e5-b016-4ab376096607 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.993498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5169-90dd-4c56-bceb-71eb1f68f353 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.997321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:57.001258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:57.023254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.024216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.024689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.025075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.035573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.035573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.039821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.040009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.040228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.040436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.041164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:57.043131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.043131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.048878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 414/823] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:57.051862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:57.052761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:57.053731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:57.054603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.057980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 410/824] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:57.059064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.170610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c764-cc5b-4ad0-bd28-c32afbecd81a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.192615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0608-132a-4340-bd42-b34bc0114758 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.216256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.217491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.218354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.219068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.220154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.222461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.229240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.229861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.230186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.230463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.242960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.244683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.253873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 411/825] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:19:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:19:57.255567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:57.262809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:57.263849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:57.264736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:57.264736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:57.264736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:57.264736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 415/826] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:57.270095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.297937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:57.302028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:57.388228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba77e9-e7d4-458b-bda8-7c18e837564e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.389335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d9922-f8c0-4b26-81b2-cc10796f87de None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.426450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.427164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.427447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.427721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.428474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:57.428782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.429937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.430276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.430971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.431495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.431984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.432926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:57.433499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.435138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.444534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 416/827] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:57.449882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 412/828] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:57.457402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.465785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.547284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:57.567320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b3798-b9d2-47a8-a790-be679557437d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.602842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:57.608194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.608904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.609195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.609852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.610909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e0097046a5f7407d84884097fcfc4ba3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:57.611228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.612677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.619789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 417/829] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:19:57 2022] GET /identity/v3/role_assignments?user.id=e0097046a5f7407d84884097fcfc4ba3&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:57.621387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb9281-59e7-4054-89ca-13c4e5163555 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.667800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.668466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.668752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.669028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.676846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.678417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:19:57.691688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:57.692728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:57.693640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 413/830] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:57.699221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.814768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994006a-b89e-4da2-80c3-44e34fde2e31 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.850736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6a4cd-3de3-43e2-b2ce-c79857088266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:57.851358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a4cd-3de3-43e2-b2ce-c79857088266 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.851638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a4cd-3de3-43e2-b2ce-c79857088266 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.851908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a4cd-3de3-43e2-b2ce-c79857088266 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.852607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6a4cd-3de3-43e2-b2ce-c79857088266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:57.852962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6a4cd-3de3-43e2-b2ce-c79857088266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:57.854566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6a4cd-3de3-43e2-b2ce-c79857088266 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:57.868011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 418/831] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:57.874323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:57.969007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db122a-95a8-4054-910b-3e4ae5f4a847 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.969337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db122a-95a8-4054-910b-3e4ae5f4a847 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.969597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db122a-95a8-4054-910b-3e4ae5f4a847 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.970954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 419/832] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:57.976195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7628-d5e2-49f8-a522-bbf8bdbd6cdd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:57.976481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7628-d5e2-49f8-a522-bbf8bdbd6cdd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:57.976761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7628-d5e2-49f8-a522-bbf8bdbd6cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:57.980112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119fb73-5a58-4205-a4dc-1953ed928f63 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:57.984883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:57.996630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d40b7628-d5e2-49f8-a522-bbf8bdbd6cdd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:57.997871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d40b7628-d5e2-49f8-a522-bbf8bdbd6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:58.015858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:58.017148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.017598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.018006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e91b89f02b6a4283bd61897eaefd47ad/roles/d8d8369da6884d00a8c296ddc1619fb6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.035000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=e91b89f02b6a4283bd61897eaefd47ad, role_id=d8d8369da6884d00a8c296ddc1619fb6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:58.036465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:58.046688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:58.057705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 414/833] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:19:57 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e91b89f02b6a4283bd61897eaefd47ad/roles/d8d8369da6884d00a8c296ddc1619fb6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:19:58.077758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 420/834] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:19:58.102396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:58.218587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01930-5f3b-41f4-914b-d80fa372f92d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:58.254839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:58.255483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.255764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.256037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.269140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:19:58.274279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:58.275441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:58.276426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 415/835] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:58.281656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7628-d5e2-49f8-a522-bbf8bdbd6cdd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:58.385166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7628-d5e2-49f8-a522-bbf8bdbd6cdd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:58.428672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:58.429295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.429600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.429874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.430543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:58.430844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:58.432853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:58.434346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:58.442151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 421/836] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:58.448132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:58.508895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:58.553074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d5e2-02db-4562-b525-1606862d5a1a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:58.588575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:58.589211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.589521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.589795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.600387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:58.601967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:58.616779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:58.617765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:58.618714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:58.618714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:58.618714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:58.618714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 416/837] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:58.624195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:58.730161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dea71-a0d2-4f3e-99ef-3f22d1dbd59a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:58.765516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:58.766137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.766419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.766698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.767351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:58.767655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:58.769313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:58.782528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 422/838] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:58.788320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:58.891750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8250b-f754-4a87-84f8-9755c481136b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:58.903002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:58.929543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:58.930199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.930472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.930739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.939545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:58.940991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:19:58.952587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:58.953547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:58.954467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 417/839] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:19:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:58.959490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.020176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:59.065216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb2b40-a5f8-402c-bb0b-30e98f214ea9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:59.100754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4190b6-dfff-4d3c-a390-da9677492658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:59.101385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4190b6-dfff-4d3c-a390-da9677492658 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.101665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4190b6-dfff-4d3c-a390-da9677492658 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.101935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4190b6-dfff-4d3c-a390-da9677492658 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.102660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4190b6-dfff-4d3c-a390-da9677492658 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:59.103039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4190b6-dfff-4d3c-a390-da9677492658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:59.105155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4190b6-dfff-4d3c-a390-da9677492658 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.124150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 423/840] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Aug 8 02:19:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:59.130526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.177510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122575-ec39-477a-be1b-faa44bae6b82 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.177837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122575-ec39-477a-be1b-faa44bae6b82 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.178058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122575-ec39-477a-be1b-faa44bae6b82 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.179749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 424/841] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:59.184886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26cbdf-8e5d-4178-8965-c1b289b0b879 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.185163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26cbdf-8e5d-4178-8965-c1b289b0b879 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.185461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26cbdf-8e5d-4178-8965-c1b289b0b879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.208939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4d26cbdf-8e5d-4178-8965-c1b289b0b879 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:59.210984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4d26cbdf-8e5d-4178-8965-c1b289b0b879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:59.242548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea5a31-6617-4fa3-b563-1c734eb81605 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:59.282016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:59.283183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.283667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.284200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.291803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 425/842] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:19:59.313186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26cbdf-8e5d-4178-8965-c1b289b0b879 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.333105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:59.359073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:59.368168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:59.370404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.412875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26cbdf-8e5d-4178-8965-c1b289b0b879 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:59.447339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:59.447836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.448106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.448375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.448966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:59.450703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:59.460313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:59.461568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:19:59.462553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:19:59.465764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 426/843] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:19:59.467505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.488738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 418/844] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:19:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:59.489914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.563264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:59.572225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30a56-a67a-49df-bbde-13cabbf31629 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:59.582982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:59.602462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51be8-d886-4d9f-8a3b-bc1d78e16c26 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:59.610178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:59.610795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.611451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.611451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.612056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:59.612359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:59.613917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.623721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 427/845] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:19:59.624796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.643613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:59.644555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.645164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.645735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.660015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:59.661848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:19:59.677918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:19:59.678890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:19:59.679771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:19:59.679771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:19:59.679771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:19:59.687214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 419/846] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:19:59.688346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.730891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356aca-399d-4daf-a5a1-d1a72139352f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:59.766555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85042b1e-c6c9-4a3f-ba85-9141690bc2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:59.767755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85042b1e-c6c9-4a3f-ba85-9141690bc2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.767755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85042b1e-c6c9-4a3f-ba85-9141690bc2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.767964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85042b1e-c6c9-4a3f-ba85-9141690bc2e8 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.768447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85042b1e-c6c9-4a3f-ba85-9141690bc2e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:59.768749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85042b1e-c6c9-4a3f-ba85-9141690bc2e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:59.770145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85042b1e-c6c9-4a3f-ba85-9141690bc2e8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.781815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 428/847] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:19:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:59.803601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd07a3-e682-4e46-828d-434f830a1f35 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:59.832000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:59.846285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:59.846955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.847233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.847507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.848208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:19:59.848518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:59.850072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.866520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 420/848] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:19:59.866729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03cf4f-22b5-43e5-a9a9-6724b985a38d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.866940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03cf4f-22b5-43e5-a9a9-6724b985a38d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.867218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03cf4f-22b5-43e5-a9a9-6724b985a38d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.871762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 429/849] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:19:59.873531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:59.874786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcaa86-cc4b-4b4f-bbd8-123c268a18e1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:59.875072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcaa86-cc4b-4b4f-bbd8-123c268a18e1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:59.875345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcaa86-cc4b-4b4f-bbd8-123c268a18e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:59.894511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-15fcaa86-cc4b-4b4f-bbd8-123c268a18e1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:59.895730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-15fcaa86-cc4b-4b4f-bbd8-123c268a18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:59.927225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:59.981550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 430/850] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:19:59.997682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3d0f9-1680-49b8-b4a5-091ddaf45712 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.004065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcaa86-cc4b-4b4f-bbd8-123c268a18e1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:00.038413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.039167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.039514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.039858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.047715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:00.049254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:00.061774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:00.062698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:00.063554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 421/851] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:00.068850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:00.120963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:00.140343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcaa86-cc4b-4b4f-bbd8-123c268a18e1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.186037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8355bcc-92e8-43a9-9c77-1e78fed226a6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.188539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfca610-43fe-482a-9fa8-f44466e05d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.189970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca610-43fe-482a-9fa8-f44466e05d0b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.190348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca610-43fe-482a-9fa8-f44466e05d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.190708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca610-43fe-482a-9fa8-f44466e05d0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.191397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca610-43fe-482a-9fa8-f44466e05d0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:00.192976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca610-43fe-482a-9fa8-f44466e05d0b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-acfca610-43fe-482a-9fa8-f44466e05d0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:00.203297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:00.205066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:00.206474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 431/852] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:00.209937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978cb6-98a7-425c-ad1b-ac143d1129f7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.210214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978cb6-98a7-425c-ad1b-ac143d1129f7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.210496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978cb6-98a7-425c-ad1b-ac143d1129f7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.211760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 432/853] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:20:00.212576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978cb6-98a7-425c-ad1b-ac143d1129f7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:00.230277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3938080-7fdf-40bf-8139-3ff0de2b8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.231224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938080-7fdf-40bf-8139-3ff0de2b8459 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.231724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938080-7fdf-40bf-8139-3ff0de2b8459 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.232191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938080-7fdf-40bf-8139-3ff0de2b8459 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.233064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3938080-7fdf-40bf-8139-3ff0de2b8459 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:00.233572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3938080-7fdf-40bf-8139-3ff0de2b8459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:00.235320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3938080-7fdf-40bf-8139-3ff0de2b8459 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:00.247408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:00.253538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 422/854] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:00.254879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe7116-2578-4b74-825b-fd573e7ad678 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.255225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe7116-2578-4b74-825b-fd573e7ad678 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.255509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe7116-2578-4b74-825b-fd573e7ad678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.276592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-17fe7116-2578-4b74-825b-fd573e7ad678 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:00.277865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-17fe7116-2578-4b74-825b-fd573e7ad678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:00.325206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978cb6-98a7-425c-ad1b-ac143d1129f7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.361018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.361705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.361959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.362229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.362854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:00.363154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:00.369411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:00.369557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 423/855] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:00.369557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe7116-2578-4b74-825b-fd573e7ad678 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:00.371481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 433/856] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:00.377381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:00.406273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:00.480215 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe7116-2578-4b74-825b-fd573e7ad678 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.490916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:00.499822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3de33-a1c9-41ab-987d-f827f6ef225a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.519797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.521206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.521868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.522407 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.523430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=4a07806d34b143f186cfc63ea192d6c1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:00.524183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:00.526146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:00.534595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 424/857] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/role_assignments?user.id=4a07806d34b143f186cfc63ea192d6c1&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:00.534972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.535642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.535926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.536068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:00.536200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.536839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:00.537151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:00.538694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:00.553398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 434/858] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:00.660432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:00.669883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1052-854f-4040-b919-ccc554a1e4ea None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.711835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.712767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.713091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.713394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.725792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:00.731654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:00.732636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:00.733643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 425/859] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:00.742130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:00.856314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afffa17-9d4e-45de-989f-311923b87c31 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:00.892182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:00.892722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:00.893003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:00.893276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:00.893986 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:00.894287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:00.895722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:00.905210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 435/860] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:00.910903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:01.019396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0b9f-c2e1-46f5-ba13-a8492e43d34f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:01.054690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:01.055329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.055609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.055893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.067462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:01.068932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:01.084168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:01.085119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:01.086011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:01.086011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:01.086011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:01.089116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 426/861] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:01.091625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:01.116235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:01.197648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cb397-c116-4a63-b478-75ec2eb200b2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:01.233935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:01.234557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.234884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.235164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.235816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:01.236119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:01.237514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:01.250436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 436/862] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:01.256023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:01.270070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:01.365288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1e517-930d-4cb3-b875-91062e4f8155 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:01.401015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:01.401683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.401961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.402234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.410427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:01.411903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:01.423664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:01.425874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:01.428126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 427/863] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:20:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:01.433422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:01.517236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:01.540059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8926a-6fef-4d8f-a6c3-7536d32d9290 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:01.574186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30376d6-84fd-47ec-b2cc-31143b107045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:01.575138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30376d6-84fd-47ec-b2cc-31143b107045 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.575412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30376d6-84fd-47ec-b2cc-31143b107045 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.575676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30376d6-84fd-47ec-b2cc-31143b107045 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.576404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30376d6-84fd-47ec-b2cc-31143b107045 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:01.576703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30376d6-84fd-47ec-b2cc-31143b107045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:01.578162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30376d6-84fd-47ec-b2cc-31143b107045 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:01.596510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 437/864] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Aug 8 02:20:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:01.602184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:01.675988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:01.712982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41475-0cf6-4d7b-a9b2-2b27bd853056 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:01.750876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:01.751861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.752366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.752835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.820058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1130806-3aa3-47a9-a156-cbe987ce3284 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.820259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1130806-3aa3-47a9-a156-cbe987ce3284 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.820522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1130806-3aa3-47a9-a156-cbe987ce3284 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.822298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:01.822886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 438/865] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:01.823865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:01.830598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861241f-e4d7-42f6-aaa7-9b18a0f9f13b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.831144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861241f-e4d7-42f6-aaa7-9b18a0f9f13b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.831615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861241f-e4d7-42f6-aaa7-9b18a0f9f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.850797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b861241f-e4d7-42f6-aaa7-9b18a0f9f13b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:01.852327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b861241f-e4d7-42f6-aaa7-9b18a0f9f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:01.894330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:01.937389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 439/866] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:01.946387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 428/867] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:01.952143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861241f-e4d7-42f6-aaa7-9b18a0f9f13b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:01.957461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:02.025480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:02.062894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861241f-e4d7-42f6-aaa7-9b18a0f9f13b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.086354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dfc1a-06ae-454b-9850-c8c031426ffb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.099159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.099803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.100081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.100351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.115148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.116926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.128705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.129659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.130132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.130589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.131438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.132996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:02.137801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:02.138711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:02.139564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:02.139564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:02.139564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:02.139564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 440/868] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:02.144777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:02.154655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 429/869] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:20:01 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:02.261890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0288-1721-4398-8a0b-57c64466ff59 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.285217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:02.310877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.311809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.312238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.312657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.313485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:02.313973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.315594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.329927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 441/870] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:02.338653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:02.370114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:02.449927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294915bd-1bab-4c1b-94d1-25883523114d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.488309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd101a-74a8-469a-8af5-e11607b999a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.488949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd101a-74a8-469a-8af5-e11607b999a1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.489228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd101a-74a8-469a-8af5-e11607b999a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.489530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd101a-74a8-469a-8af5-e11607b999a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.496681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd101a-74a8-469a-8af5-e11607b999a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.498213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd101a-74a8-469a-8af5-e11607b999a1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-60dd101a-74a8-469a-8af5-e11607b999a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:02.510595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:02.511500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:02.512675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 430/871] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:02.517852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:02.637928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1b47-4d12-4bc8-b895-6058b7061e46 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.674062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.674961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.675383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.675789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.676631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:02.677074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.678905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.679115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e88a-29f0-4693-9d08-a2a118eee368 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.679402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e88a-29f0-4693-9d08-a2a118eee368 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.679677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e88a-29f0-4693-9d08-a2a118eee368 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.681525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 431/872] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:02.687110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbcbba-7751-4ab1-896e-5159a118bb28 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.687396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbcbba-7751-4ab1-896e-5159a118bb28 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.687675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbcbba-7751-4ab1-896e-5159a118bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.694217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 442/873] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:02.700205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:02.709644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-eabbcbba-7751-4ab1-896e-5159a118bb28 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:02.710910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eabbcbba-7751-4ab1-896e-5159a118bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:02.739405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:02.787050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 432/874] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:02.805056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbcbba-7751-4ab1-896e-5159a118bb28 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:02.812968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47895a-07f4-4e04-82b2-bd87bf5f95b2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.825100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:02.852029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bd4c3-7376-4ab6-a64a-b2229ed5f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.853188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd4c3-7376-4ab6-a64a-b2229ed5f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.854023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd4c3-7376-4ab6-a64a-b2229ed5f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.854749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd4c3-7376-4ab6-a64a-b2229ed5f3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.855672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bd4c3-7376-4ab6-a64a-b2229ed5f3a4 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e91b89f02b6a4283bd61897eaefd47ad) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:02.856282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bd4c3-7376-4ab6-a64a-b2229ed5f3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.858206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bd4c3-7376-4ab6-a64a-b2229ed5f3a4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.869008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 443/875] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:02 2022] GET /identity/v3/role_assignments?user.id=e91b89f02b6a4283bd61897eaefd47ad&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:02.870525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc56a-7f50-419e-b2c8-ac5daab18866 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.870876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc56a-7f50-419e-b2c8-ac5daab18866 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.871213 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc56a-7f50-419e-b2c8-ac5daab18866 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.872650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 444/876] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:02.878863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94368e-8625-42fa-b2d1-750f8ba61416 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.879453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94368e-8625-42fa-b2d1-750f8ba61416 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.879937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94368e-8625-42fa-b2d1-750f8ba61416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.900675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4e94368e-8625-42fa-b2d1-750f8ba61416 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:02.902417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e94368e-8625-42fa-b2d1-750f8ba61416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:02.923287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbcbba-7751-4ab1-896e-5159a118bb28 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:02.963011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:02.963770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:02.964049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:02.964366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:02.965078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:02.966604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:02.986298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 445/877] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:02.990587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 433/878] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:20:02 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:20:03.017263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94368e-8625-42fa-b2d1-750f8ba61416 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:03.054452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:03.135069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94368e-8625-42fa-b2d1-750f8ba61416 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:03.178105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:03.178743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.179060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.179284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.179866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:03.181543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:03.190323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:03.191320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:03.192191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 446/879] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:03.197649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:03.281668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:03.304951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17153fa4-5f41-4c8e-a720-5d76d2bf2d0e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:03.340737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614de50-e4ee-4cc3-98c2-b4daef9bd2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:03.341426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614de50-e4ee-4cc3-98c2-b4daef9bd2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.341656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614de50-e4ee-4cc3-98c2-b4daef9bd2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.341927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614de50-e4ee-4cc3-98c2-b4daef9bd2d4 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.342571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614de50-e4ee-4cc3-98c2-b4daef9bd2d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:03.342874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614de50-e4ee-4cc3-98c2-b4daef9bd2d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:03.344264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614de50-e4ee-4cc3-98c2-b4daef9bd2d4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:03.349664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 434/880] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:03.355392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:03.457211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:03.467134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a8a93-8975-4e06-b71c-b7214f75383d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:03.507167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a427-64ec-4517-b70a-9fa89da216a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:03.508160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a427-64ec-4517-b70a-9fa89da216a1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.508629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a427-64ec-4517-b70a-9fa89da216a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.509154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a427-64ec-4517-b70a-9fa89da216a1 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.510101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a427-64ec-4517-b70a-9fa89da216a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:03.510596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a427-64ec-4517-b70a-9fa89da216a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:03.512188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a427-64ec-4517-b70a-9fa89da216a1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:03.517689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 447/881] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:04.292469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd73d2-bef2-42ce-85b9-dbc38bc14571 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.292740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd73d2-bef2-42ce-85b9-dbc38bc14571 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.293012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd73d2-bef2-42ce-85b9-dbc38bc14571 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.294732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 435/882] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:04.300119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100377a-324f-4762-a9a9-436d00b9d161 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.300557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100377a-324f-4762-a9a9-436d00b9d161 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.300718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100377a-324f-4762-a9a9-436d00b9d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.319675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8100377a-324f-4762-a9a9-436d00b9d161 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:04.320848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8100377a-324f-4762-a9a9-436d00b9d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:04.393473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 448/883] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:04.410368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd73d2-bef2-42ce-85b9-dbc38bc14571 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:04.517585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd73d2-bef2-42ce-85b9-dbc38bc14571 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:04.552417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:04.552975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.553255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.553567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.554158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:04.555544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:04.564645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:04.565624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:04.566442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 436/884] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:20:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:04.572596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100377a-324f-4762-a9a9-436d00b9d161 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:04.672006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:04.689399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100377a-324f-4762-a9a9-436d00b9d161 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:04.725100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:04.725885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.726160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.726433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.727065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:04.727364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:04.728821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:04.737476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 449/885] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:20:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:04.739981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:04.749967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:04.843486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89115c-4a0f-4f08-be1e-b867124395b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:04.877730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:04.878342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.878701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.878902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.879545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:04.879854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:04.881252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:04.887570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 437/886] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:20:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:04.893313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.000870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e4e67-462e-44e7-80e2-3ad1f0c801ee None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.035882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c75cad-996f-4963-a8c2-a244f4e5c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.036943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c75cad-996f-4963-a8c2-a244f4e5c565 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.037414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c75cad-996f-4963-a8c2-a244f4e5c565 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.037853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c75cad-996f-4963-a8c2-a244f4e5c565 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.038718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c75cad-996f-4963-a8c2-a244f4e5c565 None admin] RBAC: Adding query filter params (interface=public, service_id=420fd52d554c44a79e9d4dfc02fb7cc2, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:05.039470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c75cad-996f-4963-a8c2-a244f4e5c565 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:05.041176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c75cad-996f-4963-a8c2-a244f4e5c565 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:05.051330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 450/887] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:20:04 2022] GET /identity/v3/endpoints?service_id=420fd52d554c44a79e9d4dfc02fb7cc2&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:05.052498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.097225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9c9e5-601e-4e39-8ced-481e5d9b57da None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.097860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9c9e5-601e-4e39-8ced-481e5d9b57da None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.098306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9c9e5-601e-4e39-8ced-481e5d9b57da None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.100107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 451/888] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:20:05.105664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab8e2-89a7-4620-a242-6bafbe772af2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.106202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab8e2-89a7-4620-a242-6bafbe772af2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.106667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab8e2-89a7-4620-a242-6bafbe772af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.125425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-629ab8e2-89a7-4620-a242-6bafbe772af2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:05.126407 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:05.126820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-629ab8e2-89a7-4620-a242-6bafbe772af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:05.135798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:05.163053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357def13-0c56-484c-bf93-d15d3a47eac4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.198392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 452/889] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:05.200180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4b126-c7f2-4667-8b7d-9881bbeb79d5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.200468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4b126-c7f2-4667-8b7d-9881bbeb79d5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.200742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4b126-c7f2-4667-8b7d-9881bbeb79d5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.202022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.202909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.203445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.203958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.204763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:05.206160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 453/890] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:05.207041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:05.207237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e19967-a8fe-43d3-9598-269dcd1542b7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.207531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e19967-a8fe-43d3-9598-269dcd1542b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.207805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e19967-a8fe-43d3-9598-269dcd1542b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.215322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 438/891] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:20:05.224408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.226748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-57e19967-a8fe-43d3-9598-269dcd1542b7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:05.228178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-57e19967-a8fe-43d3-9598-269dcd1542b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:05.313902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 454/892] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:05.332060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e19967-a8fe-43d3-9598-269dcd1542b7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.344072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964031-7edd-40a7-9581-03fbc0be15b0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.385477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.386489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.386963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.387429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.388234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:05.389869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:05.392175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:05.402050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:05.403019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:05.403917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:05.411230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 439/893] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:05.413171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.485158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:05.514945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e19967-a8fe-43d3-9598-269dcd1542b7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.519855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8cf0-8a2d-42a7-a5f7-4f703eb7f17b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.554893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e997c7-a7b5-4631-b64d-34028477e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.555504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e997c7-a7b5-4631-b64d-34028477e84f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.555810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e997c7-a7b5-4631-b64d-34028477e84f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.556087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e997c7-a7b5-4631-b64d-34028477e84f None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.556720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e997c7-a7b5-4631-b64d-34028477e84f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:05.557025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e997c7-a7b5-4631-b64d-34028477e84f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:05.558440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e997c7-a7b5-4631-b64d-34028477e84f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:05.566837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59658f83-4058-4630-8566-dd1f633b7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.567804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59658f83-4058-4630-8566-dd1f633b7def None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.567935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 440/894] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:05.568416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59658f83-4058-4630-8566-dd1f633b7def None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.568901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59658f83-4058-4630-8566-dd1f633b7def None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.569180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b967f-ce2b-45a0-baff-36dbf2945558 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.569494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b967f-ce2b-45a0-baff-36dbf2945558 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.569775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b967f-ce2b-45a0-baff-36dbf2945558 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.571014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 441/895] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:05.572183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b967f-ce2b-45a0-baff-36dbf2945558 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.594431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59658f83-4058-4630-8566-dd1f633b7def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-59658f83-4058-4630-8566-dd1f633b7def None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:05.599191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:05.600305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:05.601183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 455/896] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:05.605125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19bac-5152-4f07-b9a5-944c33a733cc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19bac-5152-4f07-b9a5-944c33a733cc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.607775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19bac-5152-4f07-b9a5-944c33a733cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.638307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dfa19bac-5152-4f07-b9a5-944c33a733cc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:05.639440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dfa19bac-5152-4f07-b9a5-944c33a733cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:05.660998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:05.718794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b967f-ce2b-45a0-baff-36dbf2945558 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.730906 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 456/897] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:05.731806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa19bac-5152-4f07-b9a5-944c33a733cc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.781084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.782022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.782301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.782573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.783505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:05.783808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:05.785493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:05.793613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 442/898] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:05.794273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.807966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:05.851201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa19bac-5152-4f07-b9a5-944c33a733cc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.886680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.887569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.887996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.888262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.888983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:05.889226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:05.890671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:05.897194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43951e-a9ca-4252-a760-1e271dfa134b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:05.904116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 457/899] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:05.904116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:05.931107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:05.940335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:05.940948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:05.941222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:05.941525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:05.942174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:05.943552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:05.960448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 443/900] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:20:05 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:05.961394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:06.030926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ef82-0e0f-4550-93c7-9a079ecaf6b7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.065280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:06.089166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339188f-5660-4260-a48a-b274f752377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.090006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339188f-5660-4260-a48a-b274f752377e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.090412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339188f-5660-4260-a48a-b274f752377e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.091419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339188f-5660-4260-a48a-b274f752377e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.092266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339188f-5660-4260-a48a-b274f752377e None admin] RBAC: Adding query filter params (interface=public, service_id=6b6fdd30629648deaeb2e2c8ab27d576, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:06.092710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339188f-5660-4260-a48a-b274f752377e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:06.094241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339188f-5660-4260-a48a-b274f752377e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:06.096749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3b86-c7b0-4c95-9006-d0c23b2de739 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.102220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 458/901] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/endpoints?service_id=6b6fdd30629648deaeb2e2c8ab27d576&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:06.108210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339188f-5660-4260-a48a-b274f752377e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:06.136376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.137291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.137787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.138195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.151492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:06.154125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:06.169815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:06.170791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:06.171669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:06.171669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:06.171669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:06.171669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 444/902] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:06.176940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:06.222934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:06.248055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339188f-5660-4260-a48a-b274f752377e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.286877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.288025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.288663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.289124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.289970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:06.291754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:06.298914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 459/903] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:20:06 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:20:06.312740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ede85-921a-48d6-8465-907e79f41478 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.353401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.354059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.354341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.354616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.355296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:06.355601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:06.357045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:06.370952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 445/904] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:06.376323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:06.433102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:06.493319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31f04-64b0-49b3-ab7d-c277bc7a6340 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.529578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.530591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.531064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.531550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.539407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:06.541315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:06.553254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:06.554222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:06.555134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:06.558027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 460/905] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:20:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:06.563966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:06.663444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:06.670595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ca0e1-8e93-4f2a-b55c-9ca2b00d834a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.706029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.706560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.706840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.707112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.707865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:06.708171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:06.709642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:06.728570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 446/906] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Aug 8 02:20:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:06.733719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:06.838066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7335-7719-4898-87d5-d427a243f4c5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.847209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:06.873877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.874484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.874761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.875033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.942951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:06.944409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.044511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 461/907] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:06 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:07.050168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.157098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e852-4fbd-40ea-869e-5ffbea742b89 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:07.195294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367feac4-2482-43ee-8ffa-593ac6cf80a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:07.196254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367feac4-2482-43ee-8ffa-593ac6cf80a1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.196945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367feac4-2482-43ee-8ffa-593ac6cf80a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.197420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367feac4-2482-43ee-8ffa-593ac6cf80a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.208774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367feac4-2482-43ee-8ffa-593ac6cf80a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:07.210521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367feac4-2482-43ee-8ffa-593ac6cf80a1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-367feac4-2482-43ee-8ffa-593ac6cf80a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:07.226210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:07.227202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:07.228239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:07.228239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:07.228239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:07.230245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 447/908] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:07.237584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.246505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:07.343053 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31428fb8-788d-43a3-98fe-419e4dd39ccb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:07.365095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425bfbb-947d-4017-8692-7fae7a34a542 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.365447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425bfbb-947d-4017-8692-7fae7a34a542 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.365761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425bfbb-947d-4017-8692-7fae7a34a542 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.367368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 448/909] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:07.372346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88592fd-ed2e-48d1-b254-ef59c7613dc3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.372661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88592fd-ed2e-48d1-b254-ef59c7613dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.372968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88592fd-ed2e-48d1-b254-ef59c7613dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.381044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:07.382580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:07.383862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.384378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.384856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.385677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:07.386123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:07.387630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.394562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a88592fd-ed2e-48d1-b254-ef59c7613dc3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:07.395744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a88592fd-ed2e-48d1-b254-ef59c7613dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:07.403794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 462/910] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:07.414314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.465107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 449/911] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:07.487017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88592fd-ed2e-48d1-b254-ef59c7613dc3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.498517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:07.542694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dead0-c0b9-4473-a73a-403fa1de94c6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:07.588194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:07.589457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.590341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.591096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.596608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88592fd-ed2e-48d1-b254-ef59c7613dc3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:07.601429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:07.603162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:07.620210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:07.621250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:07.622151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:07.628370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 463/912] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:07.630940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.646663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:07.647763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.648061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.648318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.648914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:07.651322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.653706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:07.664779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:07.666133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:20:07.667135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:07.670094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 450/913] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:07.675502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.757047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec519-6f85-41d8-a33d-1d671fecfec5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:07.784649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:07.794362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:07.795029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.795308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.795577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.796681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:07.796681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:07.798189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.811467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0f44-5745-4b32-930d-1d5e6d063698 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:07.817028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 464/914] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:07.818940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.852545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:07.853157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:07.853554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:07.853929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:07.854547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:07.854848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:07.856434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.866319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 451/915] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:07.867968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:07.932988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:07.959807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36614c0d-5891-4874-8967-73ce59db2ce1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:07.974931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282d6e8-74ec-4514-91c9-af51e4c031d1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:08.001288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.001820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.002097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.002362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.003082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] RBAC: Adding query filter params (role.id=2410df59e1c247df95d53a3043e19234, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e91b89f02b6a4283bd61897eaefd47ad) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:08.003383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.004809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.017631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 465/916] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/role_assignments?user.id=e91b89f02b6a4283bd61897eaefd47ad&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=2410df59e1c247df95d53a3043e19234 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:08.025935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163f15f-64c7-4505-996a-52a349a636b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.026556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f15f-64c7-4505-996a-52a349a636b2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.026833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f15f-64c7-4505-996a-52a349a636b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.027110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f15f-64c7-4505-996a-52a349a636b2 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.027765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f15f-64c7-4505-996a-52a349a636b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:08.028059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f15f-64c7-4505-996a-52a349a636b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.029610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f15f-64c7-4505-996a-52a349a636b2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.035767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 452/917] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Aug 8 02:20:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:08.041736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.100565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:08.123127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227561-0baf-4fe2-b635-47cc6f99550e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.123309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227561-0baf-4fe2-b635-47cc6f99550e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.123589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227561-0baf-4fe2-b635-47cc6f99550e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.125494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 453/918] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:08.131129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf24bd-ae05-40d8-b792-dd84afd6502d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.131441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf24bd-ae05-40d8-b792-dd84afd6502d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.131686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf24bd-ae05-40d8-b792-dd84afd6502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.152058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-84cf24bd-ae05-40d8-b792-dd84afd6502d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:08.153398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84cf24bd-ae05-40d8-b792-dd84afd6502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:08.155626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775374d-6267-479a-8189-3195a269b2e9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:08.193104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.193765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.194040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.194311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.194993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.196499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.222124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 466/919] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:20:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:08.249539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 454/920] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:08.267415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.379528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384fd3-3318-4d9d-ae74-126b248b6abd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:08.389609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:08.420350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52dcb9-96da-45b4-aaa8-053ba7b94af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.420996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52dcb9-96da-45b4-aaa8-053ba7b94af1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.421273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52dcb9-96da-45b4-aaa8-053ba7b94af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.421569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52dcb9-96da-45b4-aaa8-053ba7b94af1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.422155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52dcb9-96da-45b4-aaa8-053ba7b94af1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.423526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52dcb9-96da-45b4-aaa8-053ba7b94af1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4d52dcb9-96da-45b4-aaa8-053ba7b94af1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:08.432861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:08.433941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:08.434947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 467/921] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:08.443094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf24bd-ae05-40d8-b792-dd84afd6502d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.497110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:08.545557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf24bd-ae05-40d8-b792-dd84afd6502d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:08.554122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d95a-db65-4477-a7d3-b13b7a805f44 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.554732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d95a-db65-4477-a7d3-b13b7a805f44 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.555138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d95a-db65-4477-a7d3-b13b7a805f44 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.557191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 468/922] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:08.562624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef589e-4e51-42ec-8465-e4d2b149f934 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.562981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef589e-4e51-42ec-8465-e4d2b149f934 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.563317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef589e-4e51-42ec-8465-e4d2b149f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.582315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2fef589e-4e51-42ec-8465-e4d2b149f934 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:08.583588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2fef589e-4e51-42ec-8465-e4d2b149f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:08.584203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.585017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.585610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.586023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.586809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:08.587588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.588967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.599058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 455/923] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:08.604820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.675363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 469/924] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:08.693665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef589e-4e51-42ec-8465-e4d2b149f934 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.710995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5eb7-728e-4666-9fdd-1403a413719f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:08.728191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:08.747926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.748538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.748811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.749077 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.749746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:08.750046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.752061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.757421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 456/925] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:08.763430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.807623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef589e-4e51-42ec-8465-e4d2b149f934 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:08.809751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:08.846374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.847489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.847960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.848533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.849338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.851014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:08.860576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:08.861549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:20:08.862421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:08.870425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bbd50-3ddc-4fd5-9e0c-8d21a720c161 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:08.870758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 470/926] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Aug 8 02:20:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:08.871956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.906341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:08.907226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:08.907336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:08.907613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:08.908320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] RBAC: Adding query filter params (interface=public, service_id=b31203a3235246339ff47fcc93d9067e, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:08.908629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:08.910196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:08.915951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 457/927] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:20:08 2022] GET /identity/v3/endpoints?service_id=b31203a3235246339ff47fcc93d9067e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:08.921522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:08.969793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:08.984378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c268c-5ef5-4a89-b43c-b5582f2b49e6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:09.021026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:09.022085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:09.022617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:09.023209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:09.024114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:09.024695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:09.026444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:09.026655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b680ec7-3dfa-41fd-89e3-e4748ce088d7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:09.032102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 471/928] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:09.039076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:09.061955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:09.062615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:09.062938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:09.063210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:09.063818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:09.065326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:09.077512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 458/929] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:20:08 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:20:09.078613 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:09.154243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67916f44-3498-4a58-9dda-27980631bbe9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:09.191781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8bbc-a572-4dbd-9ee4-448c9247ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:09.192792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8bbc-a572-4dbd-9ee4-448c9247ecab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:09.193321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8bbc-a572-4dbd-9ee4-448c9247ecab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:09.193867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8bbc-a572-4dbd-9ee4-448c9247ecab None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:09.194729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d8bbc-a572-4dbd-9ee4-448c9247ecab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:09.195225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d8bbc-a572-4dbd-9ee4-448c9247ecab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:09.196954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d8bbc-a572-4dbd-9ee4-448c9247ecab None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:09.203610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 472/930] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:09.209836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:09.317680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc3906-06ab-4858-9913-268a740952cf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:09.327518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:09.352153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729404d8-2010-4180-a152-51e1db196701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:09.352914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729404d8-2010-4180-a152-51e1db196701 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:09.353324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729404d8-2010-4180-a152-51e1db196701 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:09.353635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729404d8-2010-4180-a152-51e1db196701 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:09.354301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729404d8-2010-4180-a152-51e1db196701 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:09.355668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729404d8-2010-4180-a152-51e1db196701 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:09.381118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 459/931] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:20:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:10.136891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a324e-2043-42e0-9d48-d8182f602dd9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.137451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a324e-2043-42e0-9d48-d8182f602dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.137451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a324e-2043-42e0-9d48-d8182f602dd9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.138921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 473/932] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:10.144429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd1959-3963-4da0-9884-c74a92603b1e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.144843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd1959-3963-4da0-9884-c74a92603b1e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.145049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd1959-3963-4da0-9884-c74a92603b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.163580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8ecd1959-3963-4da0-9884-c74a92603b1e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:10.164778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8ecd1959-3963-4da0-9884-c74a92603b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:10.243387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 460/933] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:10.265615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a324e-2043-42e0-9d48-d8182f602dd9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:10.364259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:10.372180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a324e-2043-42e0-9d48-d8182f602dd9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:10.397894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb52a9-39ab-4e3c-a5e2-6aed4ee973dd None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.398173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb52a9-39ab-4e3c-a5e2-6aed4ee973dd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.398365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb52a9-39ab-4e3c-a5e2-6aed4ee973dd None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.400042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 461/934] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:10.405238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92bb8-0456-4b19-a770-e25aab235c9c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.405557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92bb8-0456-4b19-a770-e25aab235c9c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.405831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92bb8-0456-4b19-a770-e25aab235c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.413454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:10.414308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.414775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.415234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.424894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-36f92bb8-0456-4b19-a770-e25aab235c9c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:10.426219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:10.426358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-36f92bb8-0456-4b19-a770-e25aab235c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:10.431553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:10.432669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:10.433759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:10.436045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 474/935] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Aug 8 02:20:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:10.442101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:10.513481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 462/936] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:10.530980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f92bb8-0456-4b19-a770-e25aab235c9c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:10.544068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea20d-fbae-4013-b8ba-e4062d614681 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:10.557869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:10.585256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:10.585918 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.586194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.586460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.587193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:10.587510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:10.588910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:10.605670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 475/937] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Aug 8 02:20:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:10.607292 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:10.626415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:10.669757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f92bb8-0456-4b19-a770-e25aab235c9c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:10.705775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:10.706705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.707175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.707666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.708437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:10.710061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:10.710571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceb045-53e3-49fe-a284-e6f90c18956b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:10.713199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING keystone.server.flask.common [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 02:20:10.731982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.sql.core [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:20:10.731982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 02:20:10.731982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [parameters: {'id': 'c060f264518141b88011836efebe1c04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 02:20:10.731982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:20:10.745825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:10.746513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.746799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.747074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c060f264518141b88011836efebe1c04.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c060f264518141b88011836efebe1c04. Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:20:10.751479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result.read() Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 08 02:20:10.752423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application yield resource Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise self.value Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application session.commit() Aug 08 02:20:10.753644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:20:10.754566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:20:10.755428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result.read() Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:20:10.756181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [parameters: {'id': 'c060f264518141b88011836efebe1c04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:10.757024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:10.759093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c060f264518141b88011836efebe1c04. Aug 08 02:20:10.759987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.760521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:10.760521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:10.762742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 463/938] 10.222.0.25 () {60 vars in 1140 bytes} [Mon Aug 8 02:20:10 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:10.771551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:10.775221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:10.776333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:10.777450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:10.777450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:10.777450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:10.783736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 476/939] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:10.784805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:10.856793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:10.857748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:10.883159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f1ce7-7fe2-4a09-96a8-eecf786914f6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:10.887918 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaaafc-0b54-46e5-a2e7-dcc4a354f312 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:10.922047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:10.922341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:10.922813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.923181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.923469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:10.923606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.924061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:10.924456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:10.924629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:10.924929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:10.926502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:10.933234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:10.935194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:10.944365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 477/940] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:10.945457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:10.949996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:10.950870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:10.951738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:10.958749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 464/941] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:10.960263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.049420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847f29-c7db-4542-a2b0-466a230c4b2c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.069634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a2df1-7b33-4b81-a2f9-94f7bdf09486 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.077730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:11.085985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.087103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.087103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.087467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.095303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.096914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:11.109483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:11.110514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:11.111439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:11.115461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848f795-890a-43eb-9b1d-e864a75cc5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.115743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 478/942] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:20:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:11.116548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848f795-890a-43eb-9b1d-e864a75cc5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.116670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.117220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848f795-890a-43eb-9b1d-e864a75cc5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.117724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848f795-890a-43eb-9b1d-e864a75cc5d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.119334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848f795-890a-43eb-9b1d-e864a75cc5d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:11.119882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848f795-890a-43eb-9b1d-e864a75cc5d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.121734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848f795-890a-43eb-9b1d-e864a75cc5d5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.126019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:11.145941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 465/943] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:20:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:11.154208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1754ab-b62f-46f6-a5b9-8527e414409f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.154446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1754ab-b62f-46f6-a5b9-8527e414409f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.154792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1754ab-b62f-46f6-a5b9-8527e414409f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.160892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 466/944] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:11.162423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64211824-6457-4304-95d4-90dc051164aa None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.162815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64211824-6457-4304-95d4-90dc051164aa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.163098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64211824-6457-4304-95d4-90dc051164aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.184902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-64211824-6457-4304-95d4-90dc051164aa None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:11.186747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-64211824-6457-4304-95d4-90dc051164aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:11.230042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5b75-e875-4abf-8691-3da3a183d6dd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.269768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 467/945] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:11.270534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.271220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.271645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.271967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.272718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:11.273022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.274644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.286683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64211824-6457-4304-95d4-90dc051164aa None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.297671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 479/946] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:11.305930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.368415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:11.420522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64211824-6457-4304-95d4-90dc051164aa None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.445217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7879-0d2f-4dd9-a35b-a719d4b085ed None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.454216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:11.464176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.464813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.465090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.465357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.465984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.467372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:11.476704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:11.478087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:11.479046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 468/947] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:11.486687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.495961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462c8d6-4dcd-44d4-b8a5-8c7c811398a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.496610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462c8d6-4dcd-44d4-b8a5-8c7c811398a2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.496890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462c8d6-4dcd-44d4-b8a5-8c7c811398a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.497160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462c8d6-4dcd-44d4-b8a5-8c7c811398a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.511099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462c8d6-4dcd-44d4-b8a5-8c7c811398a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.513167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462c8d6-4dcd-44d4-b8a5-8c7c811398a2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a462c8d6-4dcd-44d4-b8a5-8c7c811398a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:11.529640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:11.530599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:11.531458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:11.531458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:11.531458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:11.531458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 480/948] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:11.532109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64347ba-a265-4780-a22e-665efb187070 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.532267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64347ba-a265-4780-a22e-665efb187070 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.532514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64347ba-a265-4780-a22e-665efb187070 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.537406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 481/949] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:11.537406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64347ba-a265-4780-a22e-665efb187070 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.608366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb594d5-9b64-4f97-8017-3fd295c1a6a9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.646892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fe688-7396-465a-b1ad-93629768bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.647633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fe688-7396-465a-b1ad-93629768bb5e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.647967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fe688-7396-465a-b1ad-93629768bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.648306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fe688-7396-465a-b1ad-93629768bb5e None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.649003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fe688-7396-465a-b1ad-93629768bb5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:11.649469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fe688-7396-465a-b1ad-93629768bb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.650910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fe688-7396-465a-b1ad-93629768bb5e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.656279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:11.657552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 469/950] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:11.658846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a2af-767d-458c-96f6-a682fd92c890 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.659146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a2af-767d-458c-96f6-a682fd92c890 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.659410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a2af-767d-458c-96f6-a682fd92c890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.665992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64347ba-a265-4780-a22e-665efb187070 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.689399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8e12a2af-767d-458c-96f6-a682fd92c890 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:11.690791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8e12a2af-767d-458c-96f6-a682fd92c890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:11.704627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.705182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.705480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.705749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.706389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:11.706685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.708044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.720594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 482/951] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:11.721451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.753680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:11.785389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 470/952] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:11.785389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a2af-767d-458c-96f6-a682fd92c890 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.825801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4f95-42ea-4827-b00a-c5763f426afa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.863027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.863643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.863921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.864190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.864824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:11.865125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.866536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.872148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 483/953] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:11.872869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.898451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:11.901793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a2af-767d-458c-96f6-a682fd92c890 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:11.937171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:11.937854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:11.938132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:11.938403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:11.945248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:11.946934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:11.960474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:11.961358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 471/954] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:11.962607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:11.980307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c11d8b-fe8c-428c-9ae2-b7326e9d3850 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:12.013626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:12.023349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:12.023991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:12.024345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:12.024783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:12.025758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:12.027138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:12.037740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:12.038892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:12.039751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:12.041616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 484/955] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:12.042455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:12.077949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390cb15-cf51-4dc6-8fdb-a5c05881f819 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:12.112130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:12.112705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:12.112984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:12.113256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:12.113942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:12.115333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:12.132686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:12.138228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 472/956] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:20:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:12.139114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:12.162257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34b2d-0181-4ba6-af0c-0b144ac6825c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:12.219231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:12.219752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:12.220031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:12.220374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:12.221103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:12.221425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:12.223595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:12.247500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 485/957] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:12.249255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:12.290202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:12.295807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dda6-1683-4191-bcc4-8c8dbd4a6f30 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:12.344201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:12.344904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:12.345238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:12.345906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:12.346307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:12.346671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:12.348867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:12.353698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 473/958] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:20:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:12.359427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:12.378250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca5b1-e810-44d2-bce3-cbd6a18b2a2a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:12.416032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0e79-bc65-4c17-b1e3-8d3aec50ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:12.416594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0e79-bc65-4c17-b1e3-8d3aec50ef0c None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:12.416919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0e79-bc65-4c17-b1e3-8d3aec50ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:12.417198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0e79-bc65-4c17-b1e3-8d3aec50ef0c None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e91b89f02b6a4283bd61897eaefd47ad/roles/2410df59e1c247df95d53a3043e19234` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:12.419628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a0e79-bc65-4c17-b1e3-8d3aec50ef0c None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=e91b89f02b6a4283bd61897eaefd47ad, role_id=2410df59e1c247df95d53a3043e19234)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:12.421319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a0e79-bc65-4c17-b1e3-8d3aec50ef0c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:12.439019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 486/959] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:20:12 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e91b89f02b6a4283bd61897eaefd47ad/roles/2410df59e1c247df95d53a3043e19234 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:20:12.498817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c0cd-3e86-49bd-8e92-48dddc4319c9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:12.537922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9762c-a758-4a89-b9df-af04c0213aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:12.538798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9762c-a758-4a89-b9df-af04c0213aac None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:12.539256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9762c-a758-4a89-b9df-af04c0213aac None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:12.539730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9762c-a758-4a89-b9df-af04c0213aac None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:12.540600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9762c-a758-4a89-b9df-af04c0213aac None admin] RBAC: Adding query filter params (type=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:12.541145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9762c-a758-4a89-b9df-af04c0213aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:12.542928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9762c-a758-4a89-b9df-af04c0213aac None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:12.548881 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 474/960] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:20:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:13.327216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee08-2752-4f12-87ef-6c2530d53321 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.327784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee08-2752-4f12-87ef-6c2530d53321 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.327784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee08-2752-4f12-87ef-6c2530d53321 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.329439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 487/961] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:13.335226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af411237-4234-47af-9339-0e962f0f3dfa None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.335701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af411237-4234-47af-9339-0e962f0f3dfa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.335775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af411237-4234-47af-9339-0e962f0f3dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.354220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-af411237-4234-47af-9339-0e962f0f3dfa None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:13.355420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-af411237-4234-47af-9339-0e962f0f3dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:13.383802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:13.430100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 475/962] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:13.455139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ee08-2752-4f12-87ef-6c2530d53321 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:13.458405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:13.564618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ee08-2752-4f12-87ef-6c2530d53321 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:13.600229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:13.601210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.601719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.602180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.603030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:13.604645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:13.607544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING keystone.server.flask.common [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 02:20:13.625029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:20:13.625029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 02:20:13.625029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [parameters: {'user_id': '703ba36060ab4cc8835dedab14861e39', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 02:20:13.625029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Aug 08 02:20:13.632796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:20:13.633915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:20:13.635138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:20:13.636217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:20:13.637281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:20:13.638868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'user_id': '703ba36060ab4cc8835dedab14861e39', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:13.640743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 08 02:20:13.642552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 08 02:20:13.644589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 08 02:20:13.644589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 08 02:20:13.644589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:20:13.644589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:20:13.644589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 02:20:13.644589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:13.644589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 488/963] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Aug 8 02:20:13 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:13.645460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af411237-4234-47af-9339-0e962f0f3dfa None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:13.756318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af411237-4234-47af-9339-0e962f0f3dfa None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:13.792821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b90e43-c4e7-4458-a7e8-8d0efaad1603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:13.793497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90e43-c4e7-4458-a7e8-8d0efaad1603 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.793782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90e43-c4e7-4458-a7e8-8d0efaad1603 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.794056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90e43-c4e7-4458-a7e8-8d0efaad1603 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.801802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b90e43-c4e7-4458-a7e8-8d0efaad1603 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:13.803264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b90e43-c4e7-4458-a7e8-8d0efaad1603 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-53b90e43-c4e7-4458-a7e8-8d0efaad1603 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:13.817701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:13.820009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:13.822675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 476/964] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:20:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:13.827168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:13.895163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:13.938710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a2c8-e1f1-4128-9162-9d61d0f9d358 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:13.975806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f0380-fddf-4c1a-926f-867406b30814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:13.976838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f0380-fddf-4c1a-926f-867406b30814 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:13.977331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f0380-fddf-4c1a-926f-867406b30814 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:13.978006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f0380-fddf-4c1a-926f-867406b30814 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:13.978996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f0380-fddf-4c1a-926f-867406b30814 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:13.979491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f0380-fddf-4c1a-926f-867406b30814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:13.981317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f0380-fddf-4c1a-926f-867406b30814 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:14.021963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 489/965] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Aug 8 02:20:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:14.241052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171384c5-193e-4b5c-973f-f3f333befbc3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.241358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171384c5-193e-4b5c-973f-f3f333befbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.241648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171384c5-193e-4b5c-973f-f3f333befbc3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.243449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 477/966] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:14.248950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73059f-0897-432d-b1fc-a0bf157fde4c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.249238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73059f-0897-432d-b1fc-a0bf157fde4c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.249660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73059f-0897-432d-b1fc-a0bf157fde4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.269850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2f73059f-0897-432d-b1fc-a0bf157fde4c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:14.271421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f73059f-0897-432d-b1fc-a0bf157fde4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:14.340436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 490/967] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:14.362955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171384c5-193e-4b5c-973f-f3f333befbc3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:14.384614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:14.468933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171384c5-193e-4b5c-973f-f3f333befbc3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:14.502767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7ce87-4115-4eda-bf65-44490d196e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:14.503312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7ce87-4115-4eda-bf65-44490d196e44 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.503655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7ce87-4115-4eda-bf65-44490d196e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.503930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7ce87-4115-4eda-bf65-44490d196e44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.504513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7ce87-4115-4eda-bf65-44490d196e44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:14.505965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7ce87-4115-4eda-bf65-44490d196e44 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-58a7ce87-4115-4eda-bf65-44490d196e44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:14.515027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:14.516107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:14.516988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:14.521212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 478/968] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:14.522608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73059f-0897-432d-b1fc-a0bf157fde4c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:14.530883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1bd98-aaf6-4b53-92d2-f756597ff7c6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.531294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1bd98-aaf6-4b53-92d2-f756597ff7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.531571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1bd98-aaf6-4b53-92d2-f756597ff7c6 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.532976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 479/969] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:14.538576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402025a-e9c0-45a9-a67f-8d0105ad38ea None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.538864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402025a-e9c0-45a9-a67f-8d0105ad38ea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.539141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402025a-e9c0-45a9-a67f-8d0105ad38ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.557893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b402025a-e9c0-45a9-a67f-8d0105ad38ea None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:14.559118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b402025a-e9c0-45a9-a67f-8d0105ad38ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:14.579137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:14.633541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 480/970] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:14.642363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73059f-0897-432d-b1fc-a0bf157fde4c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:14.655322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402025a-e9c0-45a9-a67f-8d0105ad38ea None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:14.670044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:14.679936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c8692-d7ea-4ce7-b786-10b35b3a5013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:14.680605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8692-d7ea-4ce7-b786-10b35b3a5013 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.680885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8692-d7ea-4ce7-b786-10b35b3a5013 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.681156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8692-d7ea-4ce7-b786-10b35b3a5013 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.681827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c8692-d7ea-4ce7-b786-10b35b3a5013 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:14.682200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c8692-d7ea-4ce7-b786-10b35b3a5013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:14.683580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c8692-d7ea-4ce7-b786-10b35b3a5013 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:14.689407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 491/971] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:14.690082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6826e4-6a34-47c9-af22-34b63029b02d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.690371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6826e4-6a34-47c9-af22-34b63029b02d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.690644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6826e4-6a34-47c9-af22-34b63029b02d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.691833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 492/972] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:14.694220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6826e4-6a34-47c9-af22-34b63029b02d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:14.756199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402025a-e9c0-45a9-a67f-8d0105ad38ea None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:14.791286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cfb74-d382-4c93-bc2d-06c139547470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:14.791924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cfb74-d382-4c93-bc2d-06c139547470 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.792213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cfb74-d382-4c93-bc2d-06c139547470 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.792490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cfb74-d382-4c93-bc2d-06c139547470 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.799172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6826e4-6a34-47c9-af22-34b63029b02d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:14.802552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cfb74-d382-4c93-bc2d-06c139547470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a59cfb74-d382-4c93-bc2d-06c139547470 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:14.807263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:14.808327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:14.809203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 481/973] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Aug 8 02:20:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:14.810316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd285-c61d-41a6-a0be-6274ec813801 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.810316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd285-c61d-41a6-a0be-6274ec813801 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.810316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd285-c61d-41a6-a0be-6274ec813801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.818520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:14.828434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f26cd285-c61d-41a6-a0be-6274ec813801 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:14.829653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f26cd285-c61d-41a6-a0be-6274ec813801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:14.836903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:14.837535 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.837809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.838072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.838689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:14.838985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:14.840322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:14.845498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 493/974] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:14.846270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:14.899395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 482/975] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:14.900371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd285-c61d-41a6-a0be-6274ec813801 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:14.902633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:14.943187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5074e15-be62-4745-a0a1-7b704c484c47 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:14.976675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:14.977298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:14.977843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:14.977997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:14.978695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:14.978997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:14.980353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:14.988060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 494/976] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Aug 8 02:20:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:14.988804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.002825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd285-c61d-41a6-a0be-6274ec813801 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.031253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:15.036697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.037316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.037627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.037902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.038625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] RBAC: Adding query filter params (interface=admin, service_id=b31203a3235246339ff47fcc93d9067e, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:15.038931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.040395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.045697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 483/977] 10.222.0.25 () {56 vars in 1249 bytes} [Mon Aug 8 02:20:14 2022] GET /identity/v3/endpoints?service_id=b31203a3235246339ff47fcc93d9067e&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:15.046479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.088870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8c33e-2bd0-4eec-969b-a87759b3586d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.111572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:15.123181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.123806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.124093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.124363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.125017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.126455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.145334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 495/978] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:20:14 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:15.146176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.155369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebfd0d-6d1d-4703-b199-4f0b0312bec9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.210007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.210773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.211117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.211449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.223667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.225342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:15.244250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:15.245314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:15.246247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:15.246247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:15.246247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:15.246247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 484/979] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:15.251457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.269453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f051f8-9f09-430e-90cf-c33ef0a02c81 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.271545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:15.310055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.310589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.310869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.311140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.311754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.313129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.320645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 496/980] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:20:15 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:20:15.368072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c7e4b-87f2-4d1a-8a0b-bf27e4c91625 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.386133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:15.411533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.412159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.412438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.412703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.413361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:15.413691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.415331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.429498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 485/981] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:15.435859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.548130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac82f8-de82-415c-83d5-50503ce4dbae None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.584707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.585262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.585569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.585843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.593342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.594802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:15.606608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:15.607781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:15.608690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 497/982] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:20:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:15.614077 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.729401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50c7e9-1250-420a-b3be-41875ff84693 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.764764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.765390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.765674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.765948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.766684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:15.766983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:15.768432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:15.786199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 486/983] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Aug 8 02:20:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:15.791966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:15.820701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:15.892809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69afdac-f89f-426e-ba4b-ea18984c3c5e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:15.927776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:15.928395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:15.928674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:15.928943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:15.999265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:16.000726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:16.027872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:16.102566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 498/984] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:15 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:16.108335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:16.138964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:16.205794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2172-2c82-4cb4-9c66-b829127d75e4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:16.240073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:16.240698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.241163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.241691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.254234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:16.255703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:16.270645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:16.271873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:16.272950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:16.272950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:16.272950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:16.274143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 487/985] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:16.279694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:16.386517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049bc5-cb95-482e-8459-6013d2dc3df9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:16.413131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:16.424497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:16.425129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.425408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.425690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.426347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:16.426647 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:16.428065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:16.441017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 499/986] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:16.446658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:16.535086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:16.552150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1550-85c1-4707-bfa2-f8948a7e4fcd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:16.585683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:16.586300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.586583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.586880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.593516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:16.594972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:16.606221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:16.607085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:16.607975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 488/987] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:16.618113 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:16.726056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996c75-5b6e-4f1b-8111-752387c477bb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:16.760990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236511-6a60-4317-bd92-a71ef481f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:16.761680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236511-6a60-4317-bd92-a71ef481f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.761956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236511-6a60-4317-bd92-a71ef481f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.762221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236511-6a60-4317-bd92-a71ef481f3a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.762952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236511-6a60-4317-bd92-a71ef481f3a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:16.763256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236511-6a60-4317-bd92-a71ef481f3a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:16.764693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236511-6a60-4317-bd92-a71ef481f3a4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:16.777534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 500/988] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:16.783459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:16.887775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850842df-137a-40d1-8ce6-226c46c16b39 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:16.921011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cf0f-c3f1-4b42-9433-f552a1d1920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:16.921633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cf0f-c3f1-4b42-9433-f552a1d1920e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:16.921909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cf0f-c3f1-4b42-9433-f552a1d1920e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:16.922172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cf0f-c3f1-4b42-9433-f552a1d1920e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:16.922900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303cf0f-c3f1-4b42-9433-f552a1d1920e None admin] RBAC: Adding query filter params (role.id=2410df59e1c247df95d53a3043e19234, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e91b89f02b6a4283bd61897eaefd47ad) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:16.923203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303cf0f-c3f1-4b42-9433-f552a1d1920e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:16.924635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303cf0f-c3f1-4b42-9433-f552a1d1920e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:16.930792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 489/989] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:16 2022] GET /identity/v3/role_assignments?user.id=e91b89f02b6a4283bd61897eaefd47ad&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=2410df59e1c247df95d53a3043e19234 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:17.249598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321730-8776-43ea-a3af-5b49233a10f1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.249945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321730-8776-43ea-a3af-5b49233a10f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.250145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321730-8776-43ea-a3af-5b49233a10f1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.251534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 501/990] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:17.256930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0d00-f709-4b78-b0ae-9dee4815e716 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.257200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0d00-f709-4b78-b0ae-9dee4815e716 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.257520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0d00-f709-4b78-b0ae-9dee4815e716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.276185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2eca0d00-f709-4b78-b0ae-9dee4815e716 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:17.277380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2eca0d00-f709-4b78-b0ae-9dee4815e716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:17.279454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:17.322209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26401e20-85ae-4618-abae-09106bd398fc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.322543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26401e20-85ae-4618-abae-09106bd398fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.322782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26401e20-85ae-4618-abae-09106bd398fc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.324700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 502/991] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:17.329495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca0f0a-c23b-497d-ab6e-a30e1fb76900 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.329780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca0f0a-c23b-497d-ab6e-a30e1fb76900 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.330068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca0f0a-c23b-497d-ab6e-a30e1fb76900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.347725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 490/992] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:17.347924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ccca0f0a-c23b-497d-ab6e-a30e1fb76900 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:17.349126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ccca0f0a-c23b-497d-ab6e-a30e1fb76900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:17.370013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0d00-f709-4b78-b0ae-9dee4815e716 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.394242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:17.422798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 503/993] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:17.444631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca0f0a-c23b-497d-ab6e-a30e1fb76900 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.473940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0d00-f709-4b78-b0ae-9dee4815e716 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:17.509853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:17.510414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.510673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.510935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.511510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:17.512882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:17.521628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:17.522641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:17.523469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 491/994] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:17.529057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.532161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:17.555825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca0f0a-c23b-497d-ab6e-a30e1fb76900 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:17.595530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:17.596168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.596439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.596706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.597288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:17.598680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:17.607561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:17.608554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:20:17.609430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:17.617021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 504/995] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Aug 8 02:20:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:17.617021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.647393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d777d5-7594-4e14-868b-9e1b992e617c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:17.659644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:17.685759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:17.686792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.686792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.687016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.687532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:17.687838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:17.689210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:17.698741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 492/996] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:20:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:17.700427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.728646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518f90-b76e-46b6-bf0b-4d0f41db2823 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:17.762826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:17.763360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.763636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.763909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.764540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:17.764849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:17.766246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:17.771682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 505/997] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:17.777089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:17.777341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.820271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bcb4a-9c4f-4878-bc18-3a1febf8cdd6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:17.855883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:17.856489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.856773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.857045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.857708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:17.858007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:17.859376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:17.865026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 493/998] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:20:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:17.871232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.880435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f9cd-8f43-48dd-a02c-8936f66ca60a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:17.883524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:17.915201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:17.915905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:17.916187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:17.916462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:17.917094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:17.917421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:17.918797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:17.923634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 506/999] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Aug 8 02:20:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:17.929223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:17.979817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535665c5-bf70-4e0a-8578-dfa3a8e07b80 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:18.007766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:18.014423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:18.014974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:18.015251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:18.015544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:18.016221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] RBAC: Adding query filter params (interface=public, service_id=12b6532c39ba45a88d680fb89a8df2de, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:18.016528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:18.017953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:18.023262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 494/1000] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:20:17 2022] GET /identity/v3/endpoints?service_id=12b6532c39ba45a88d680fb89a8df2de&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:18.028998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:18.038273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852c10-c321-496c-9458-c28396b561d9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:18.073534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad60a52-2ed9-43df-b557-38e1a61e0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:18.074503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad60a52-2ed9-43df-b557-38e1a61e0532 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:18.074785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad60a52-2ed9-43df-b557-38e1a61e0532 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:18.075054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad60a52-2ed9-43df-b557-38e1a61e0532 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:18.075734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad60a52-2ed9-43df-b557-38e1a61e0532 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:18.077096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad60a52-2ed9-43df-b557-38e1a61e0532 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:18.101441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 507/1001] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:20:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:20:18.156744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbadb2-7482-440a-97b2-b5b9a699bb06 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:18.202552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9c020-2c39-4d9d-9fd4-eaa2b5ff2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:18.203183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c020-2c39-4d9d-9fd4-eaa2b5ff2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:18.203472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c020-2c39-4d9d-9fd4-eaa2b5ff2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:18.203736 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c020-2c39-4d9d-9fd4-eaa2b5ff2fd6 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:18.204349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9c020-2c39-4d9d-9fd4-eaa2b5ff2fd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:18.205789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9c020-2c39-4d9d-9fd4-eaa2b5ff2fd6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:18.220239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 495/1002] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:20:18 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:20:18.945666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af9fb-3986-4833-b5d8-6033c24312fb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:18.946199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af9fb-3986-4833-b5d8-6033c24312fb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:18.946304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af9fb-3986-4833-b5d8-6033c24312fb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:18.947814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 508/1003] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:18.953182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560fbb1-8f63-41bc-aaf5-19e3005b3c19 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:18.953638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560fbb1-8f63-41bc-aaf5-19e3005b3c19 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:18.953805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560fbb1-8f63-41bc-aaf5-19e3005b3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:18.972239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7560fbb1-8f63-41bc-aaf5-19e3005b3c19 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:18.973426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7560fbb1-8f63-41bc-aaf5-19e3005b3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:19.023927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:19.042473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 496/1004] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:19.064181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39af9fb-3986-4833-b5d8-6033c24312fb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:19.096201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:19.177153 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39af9fb-3986-4833-b5d8-6033c24312fb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:19.212560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:19.213115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:19.213408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:19.213679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:19.214259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:19.215686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:19.225258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:19.226490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:19.227980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 509/1005] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Aug 8 02:20:19 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:19.232785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560fbb1-8f63-41bc-aaf5-19e3005b3c19 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:19.340686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560fbb1-8f63-41bc-aaf5-19e3005b3c19 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:19.374184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184e58c-4420-473d-a9a4-90595018990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:19.374791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184e58c-4420-473d-a9a4-90595018990b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:19.375064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184e58c-4420-473d-a9a4-90595018990b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:19.375333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184e58c-4420-473d-a9a4-90595018990b None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:19.375955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184e58c-4420-473d-a9a4-90595018990b None admin] RBAC: Adding query filter params (name=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:19.376254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184e58c-4420-473d-a9a4-90595018990b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:19.377655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184e58c-4420-473d-a9a4-90595018990b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:19.387215 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 497/1006] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:19.388497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:19.486491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:19.496679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398245ba-6d29-4bbd-9ff3-bbc98af14d58 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:19.531830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694399f0-5f34-420a-bde5-f2899f0a4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:19.532439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694399f0-5f34-420a-bde5-f2899f0a4bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:19.532716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694399f0-5f34-420a-bde5-f2899f0a4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:19.532988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694399f0-5f34-420a-bde5-f2899f0a4bb1 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:19.533650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694399f0-5f34-420a-bde5-f2899f0a4bb1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:19.533938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694399f0-5f34-420a-bde5-f2899f0a4bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:19.535308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694399f0-5f34-420a-bde5-f2899f0a4bb1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:19.540389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 510/1007] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:20.127026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038124e-6e75-4965-850e-8f0f6543b113 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.127615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038124e-6e75-4965-850e-8f0f6543b113 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.127615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038124e-6e75-4965-850e-8f0f6543b113 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.129111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 498/1008] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:20.134272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647f733-5b8f-4ea5-9376-d2405a4830a8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.134712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647f733-5b8f-4ea5-9376-d2405a4830a8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.134822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647f733-5b8f-4ea5-9376-d2405a4830a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.153533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6647f733-5b8f-4ea5-9376-d2405a4830a8 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:20.154705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6647f733-5b8f-4ea5-9376-d2405a4830a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:20.215191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535551d7-b9c0-4902-b707-faff9b92f1de None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.215431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535551d7-b9c0-4902-b707-faff9b92f1de None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.215716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535551d7-b9c0-4902-b707-faff9b92f1de None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.217410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 499/1009] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:20:20.222415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191fbd-09b4-4c23-8df0-3e87cbf233ec None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.222877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191fbd-09b4-4c23-8df0-3e87cbf233ec None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.222986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191fbd-09b4-4c23-8df0-3e87cbf233ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.227378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 511/1010] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:20.241772 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ee191fbd-09b4-4c23-8df0-3e87cbf233ec None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:20.243070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ee191fbd-09b4-4c23-8df0-3e87cbf233ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:20.249867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647f733-5b8f-4ea5-9376-d2405a4830a8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:20.295348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:20.320744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 500/1011] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:20.343506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee191fbd-09b4-4c23-8df0-3e87cbf233ec None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:20.348018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:20.363437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647f733-5b8f-4ea5-9376-d2405a4830a8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:20.398805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:20.399412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.399705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.399952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.401051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:20.402518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:20.409127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 512/1012] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:20.409943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:20.444853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee191fbd-09b4-4c23-8df0-3e87cbf233ec None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:20.480861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:20.481537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.481812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.482080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.482659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:20.484036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:20.492700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:20.493748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:20.494580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 501/1013] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:20.499858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:20.518309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694322f-7eec-497a-b09a-58a00ba31ea5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:20.548575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:20.556903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:20.557558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.557837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.558107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.558752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:20.560604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:20.590820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 513/1014] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:20:20 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:20.631685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad43625-7d97-4b11-834f-e36169c9027f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:20.672540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:20.673083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.673439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.673731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.674386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:20.674733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:20.676204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:20.682381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 502/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:20:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:20.688395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:20.700189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:20.801780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0534f-d58a-466b-b145-d5292f4dc4d1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:20.836993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bc2cc-bfe9-423b-b98a-9975752b4661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:20.837646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bc2cc-bfe9-423b-b98a-9975752b4661 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.837930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bc2cc-bfe9-423b-b98a-9975752b4661 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.838205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bc2cc-bfe9-423b-b98a-9975752b4661 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.838842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bc2cc-bfe9-423b-b98a-9975752b4661 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:20.839152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bc2cc-bfe9-423b-b98a-9975752b4661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:20.840531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bc2cc-bfe9-423b-b98a-9975752b4661 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:20.845634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 514/1016] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Aug 8 02:20:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:20.851526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:20.955461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa717f07-31a1-41a5-ae0a-f7657e632459 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:20.962917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:20.991732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5204a-7329-4b13-aa24-5375f2803286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:20.992343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5204a-7329-4b13-aa24-5375f2803286 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:20.992626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5204a-7329-4b13-aa24-5375f2803286 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:20.993018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5204a-7329-4b13-aa24-5375f2803286 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:20.993789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5204a-7329-4b13-aa24-5375f2803286 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:20.995205 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5204a-7329-4b13-aa24-5375f2803286 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:21.018444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 503/1017] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:20:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:20:21.527377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eaa2-7e06-4bd3-9723-96666ebdabb5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:21.527926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eaa2-7e06-4bd3-9723-96666ebdabb5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:21.527926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eaa2-7e06-4bd3-9723-96666ebdabb5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:21.529437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 515/1018] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:21.534453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c74fb-7718-4537-8cb0-44142d4aa4f2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:21.534888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c74fb-7718-4537-8cb0-44142d4aa4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:21.535029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c74fb-7718-4537-8cb0-44142d4aa4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:21.553982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-770c74fb-7718-4537-8cb0-44142d4aa4f2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:21.555349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-770c74fb-7718-4537-8cb0-44142d4aa4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:21.638844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 504/1019] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:21 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:21.661723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7eaa2-7e06-4bd3-9723-96666ebdabb5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:21.748338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:21.787402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7eaa2-7e06-4bd3-9723-96666ebdabb5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:21.822904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca315b-765c-4e1e-ada1-ec71166772d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:21.823521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca315b-765c-4e1e-ada1-ec71166772d7 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:21.823801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca315b-765c-4e1e-ada1-ec71166772d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:21.824410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca315b-765c-4e1e-ada1-ec71166772d7 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:21.825065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca315b-765c-4e1e-ada1-ec71166772d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:21.826486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca315b-765c-4e1e-ada1-ec71166772d7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:21.849405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 516/1020] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:20:21 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:22.629766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452a7b0-99d5-4ed5-8d63-31ebacb7e4b2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:22.630158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452a7b0-99d5-4ed5-8d63-31ebacb7e4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:22.630330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452a7b0-99d5-4ed5-8d63-31ebacb7e4b2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:22.631721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 505/1021] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:22.637136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307193d-332f-4457-a229-29bd6b4966ba None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:22.637612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307193d-332f-4457-a229-29bd6b4966ba None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:22.637834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307193d-332f-4457-a229-29bd6b4966ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:22.657973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e307193d-332f-4457-a229-29bd6b4966ba None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:22.659257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e307193d-332f-4457-a229-29bd6b4966ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:22.755218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 517/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:22.779628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452a7b0-99d5-4ed5-8d63-31ebacb7e4b2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:22.871723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:22.894499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452a7b0-99d5-4ed5-8d63-31ebacb7e4b2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:22.936413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7ccbb-5c4c-47c6-9357-95f9f76881e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:22.937053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7ccbb-5c4c-47c6-9357-95f9f76881e5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:22.937331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7ccbb-5c4c-47c6-9357-95f9f76881e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:22.937632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7ccbb-5c4c-47c6-9357-95f9f76881e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:22.938747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7ccbb-5c4c-47c6-9357-95f9f76881e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:22.940194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7ccbb-5c4c-47c6-9357-95f9f76881e5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:22.946701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 506/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:22.952505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307193d-332f-4457-a229-29bd6b4966ba None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:23.018484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:23.071564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307193d-332f-4457-a229-29bd6b4966ba None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:23.112635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:23.113252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.113571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.113843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:23.114511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:23.115940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:23.128542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf391-fed7-495f-a9e7-c7a84b42fd0a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.131285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf391-fed7-495f-a9e7-c7a84b42fd0a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.131599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf391-fed7-495f-a9e7-c7a84b42fd0a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:23.133508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 507/1024] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:23.142492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9ab4-d71e-491e-8d02-49026d2e230b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.143072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9ab4-d71e-491e-8d02-49026d2e230b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.143521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9ab4-d71e-491e-8d02-49026d2e230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:23.145516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 518/1025] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:20:22 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:23.168315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-05aa9ab4-d71e-491e-8d02-49026d2e230b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:23.169974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-05aa9ab4-d71e-491e-8d02-49026d2e230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:23.257343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 508/1026] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:23.284549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:23.413685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503fa3f-2a28-4d80-9f60-da39fb63114b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:23.436650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:23.465560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:23.466208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.466490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.466762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:23.478341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:23.483061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:23.483941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:23.484844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 519/1027] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Aug 8 02:20:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:23.491392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9ab4-d71e-491e-8d02-49026d2e230b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:23.598641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:23.623735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9ab4-d71e-491e-8d02-49026d2e230b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:23.665249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:23.665916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.665916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.665916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:23.666588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:23.666896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:23.668282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:23.684606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 509/1028] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Aug 8 02:20:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:23.686507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:23.817320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e2dc9-2211-4399-aa11-d2cafd813241 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:23.864094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad74f33-5cec-4e97-949c-9d90fe8f76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:23.865156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad74f33-5cec-4e97-949c-9d90fe8f76cc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.865683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad74f33-5cec-4e97-949c-9d90fe8f76cc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.866152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad74f33-5cec-4e97-949c-9d90fe8f76cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:23.878929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad74f33-5cec-4e97-949c-9d90fe8f76cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:23.880750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad74f33-5cec-4e97-949c-9d90fe8f76cc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2ad74f33-5cec-4e97-949c-9d90fe8f76cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:23.900933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:23.901951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:23.902806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:23.902806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:23.902806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:23.909389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 520/1029] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:23.911090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:23.982076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7152ba-b57c-41cb-8093-b89d54104981 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.982420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7152ba-b57c-41cb-8093-b89d54104981 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.982628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7152ba-b57c-41cb-8093-b89d54104981 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:23.984305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 521/1030] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:23.989133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c60f-8550-4fbe-9494-e12bfeb2b510 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:23.989447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c60f-8550-4fbe-9494-e12bfeb2b510 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:23.989728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c60f-8550-4fbe-9494-e12bfeb2b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.008190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4686c60f-8550-4fbe-9494-e12bfeb2b510 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:24.009562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4686c60f-8550-4fbe-9494-e12bfeb2b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:24.019511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cca059-18f1-4cad-a811-a759c50e158f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.027348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.055979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.056587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.056859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.057127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.057797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:24.058100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.059472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.070711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 510/1031] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:24.076432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.082263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 522/1032] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:24.087763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.104876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686c60f-8550-4fbe-9494-e12bfeb2b510 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.176764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cec38-9717-4014-82d2-8a5f2283c43b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.206720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686c60f-8550-4fbe-9494-e12bfeb2b510 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.210235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.210868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.211141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.211503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.219609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.221487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:24.233103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:24.234096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:20:24.235024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:24.239029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 511/1033] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:24.239682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.244630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.245265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.245568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.245816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.246437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.247869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:24.257008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:24.258217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:24.259078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 523/1034] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:24.264929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.284609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.310522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.345712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e8ecb-3de0-46bf-a0ac-55838f047830 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.380532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbeb5d-bb79-420f-8b53-6304123255cb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.384500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.385138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.385449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.385726 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.386514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:24.386822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.388338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.406550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 512/1035] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:24.412198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.426764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.427666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.427947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.428281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.428925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] RBAC: Adding query filter params (name=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:24.429235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.430832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.441027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 524/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:24.442088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.521194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7665882-c369-4817-9a0f-6c2d4516645b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.532846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.550675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.552908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349e3a-0131-44d0-b1b1-59b9b8f224ea None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.561619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.562338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.562744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.563102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.589000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.589691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.590094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.590381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.591009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] RBAC: Adding query filter params (type=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:24.591310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.592669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.597772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 525/1037] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:24.603769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.639985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.641559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.715036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba370-9359-46ea-88fa-7dc60f7a8c17 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.749404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 513/1038] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:20:24.750941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.753596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.754248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.754528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.754767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.755471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] RBAC: Adding query filter params (interface=public, service_id=f7c66fc21e7f4328a6021de089e39cd8, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:24.755779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.757145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.764617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 526/1039] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/endpoints?service_id=f7c66fc21e7f4328a6021de089e39cd8&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:24.769908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:24.783744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.784618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:24.863833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96750d-afd3-4e93-ae83-9470a7b29cdb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.877854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dca81e-d3c0-47c9-8a74-b06822b7c5e0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:24.899504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.900275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.900576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.900839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.911188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.912646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.913563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:24.914196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:24.914498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:24.915301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:24.915917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:24.917271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:24.929397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 527/1040] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:24.929612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:24.930567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:24.931443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:24.931443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:24.931443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:24.931443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 514/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:24.935271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:25.028203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:25.056158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccade3c-de3f-41d5-8650-22d3cef1ae11 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:25.097106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474d8a4-55be-47ee-a60c-5ecb4d3c3bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:25.097750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474d8a4-55be-47ee-a60c-5ecb4d3c3bdc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.098025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474d8a4-55be-47ee-a60c-5ecb4d3c3bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.098293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474d8a4-55be-47ee-a60c-5ecb4d3c3bdc None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.098979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474d8a4-55be-47ee-a60c-5ecb4d3c3bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:25.099277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474d8a4-55be-47ee-a60c-5ecb4d3c3bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:25.100626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474d8a4-55be-47ee-a60c-5ecb4d3c3bdc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:25.114391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 528/1042] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:25.120280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:25.200788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:25.235582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9d02a-5530-4121-ae6d-0d11dc2c3872 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:25.272399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a86c3-cdb3-4874-8224-f801e7362a93 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.272688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a86c3-cdb3-4874-8224-f801e7362a93 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.272966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a86c3-cdb3-4874-8224-f801e7362a93 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.273255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:25.273995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.274275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.274541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.275577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 529/1043] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:25.279801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffadd9-fd3f-4ecb-a8d5-2ce1d4d6ff51 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.280086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffadd9-fd3f-4ecb-a8d5-2ce1d4d6ff51 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.280355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffadd9-fd3f-4ecb-a8d5-2ce1d4d6ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.281580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:25.283022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:25.294297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:25.295210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:25.296072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 515/1044] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:25.301023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:25.302431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ceffadd9-fd3f-4ecb-a8d5-2ce1d4d6ff51 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:25.303601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ceffadd9-fd3f-4ecb-a8d5-2ce1d4d6ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:25.375171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 530/1045] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:25.397949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffadd9-fd3f-4ecb-a8d5-2ce1d4d6ff51 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:25.412140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a0d3d-271c-435a-90b9-8b5473810f23 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:25.452366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:25.452977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.453257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.453558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.454258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:25.454563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:25.456003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:25.464127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:25.465055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:25.469867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 516/1046] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:25.475844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:25.511641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffadd9-fd3f-4ecb-a8d5-2ce1d4d6ff51 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:25.546798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:25.547474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.547724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.547995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.559181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:25.564005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:25.564951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:25.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 531/1047] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:25.571133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:25.584280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad05c-3a2d-465d-ba70-9cc14c3867f4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:25.631784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:25.632382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.632657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.632929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.633840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] RBAC: Adding query filter params (role.id=2410df59e1c247df95d53a3043e19234, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e0097046a5f7407d84884097fcfc4ba3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:25.634373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:25.635692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:25.653474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 517/1048] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:25 2022] GET /identity/v3/role_assignments?user.id=e0097046a5f7407d84884097fcfc4ba3&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=2410df59e1c247df95d53a3043e19234 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:25.679097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512d6a7-4529-4a4b-9335-180e96c3445a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:25.706051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:25.719359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:25.720073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.720342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.720616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.721312 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:25.721645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:25.723069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:25.732807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 532/1049] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:20:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:25.738703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:25.808785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:25.849720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba104a-8d2d-4c79-8ed3-eb815fa20784 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:25.882924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:25.883826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:25.884244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:25.884662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] PATH_INFO: `/v3/users/d8854ec20ab9435d8b18f88940125147` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:25.898949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] RBAC: Authorizing `identity:get_user(user_id=d8854ec20ab9435d8b18f88940125147)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:25.900601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:25.902758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 518/1050] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:25 2022] GET /identity/v3/users/d8854ec20ab9435d8b18f88940125147 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:25.908666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:26.015753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cd472-6b4b-43cc-8e9e-75d9f57f5b65 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:26.052158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:26.052779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.053058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.053329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.114564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:26.129708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:26.131166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:26.229304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 533/1051] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:20:26.235118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:26.341782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d04120-7671-4f88-8b17-77342d48cd94 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:26.362841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:26.378643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c768-61dc-4f39-b127-5bfca79123bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:26.379273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c768-61dc-4f39-b127-5bfca79123bf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.379554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c768-61dc-4f39-b127-5bfca79123bf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.379827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c768-61dc-4f39-b127-5bfca79123bf None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.380935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c768-61dc-4f39-b127-5bfca79123bf None admin] RBAC: Authorizing `identity:get_project(project_id=11f8ab01a02e41a2822f593234f883dd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:26.382403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c768-61dc-4f39-b127-5bfca79123bf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:26.389356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 519/1052] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:26 2022] GET /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:26.390949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:26.481739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:26.498172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ee866-1672-478e-a6d7-18dd7b4533ce None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:26.533530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27dbf-8c26-45c5-b8f9-bd622de024a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:26.534150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27dbf-8c26-45c5-b8f9-bd622de024a7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.534427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27dbf-8c26-45c5-b8f9-bd622de024a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.534699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27dbf-8c26-45c5-b8f9-bd622de024a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.535426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27dbf-8c26-45c5-b8f9-bd622de024a7 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=11f8ab01a02e41a2822f593234f883dd, user.id=d8854ec20ab9435d8b18f88940125147) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:26.535737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27dbf-8c26-45c5-b8f9-bd622de024a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:26.537167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27dbf-8c26-45c5-b8f9-bd622de024a7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:26.549626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 534/1053] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:26 2022] GET /identity/v3/role_assignments?user.id=d8854ec20ab9435d8b18f88940125147&scope.project.id=11f8ab01a02e41a2822f593234f883dd&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:26.920519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843a59f-b44a-490a-a9c0-42cefa20bd78 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.921068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843a59f-b44a-490a-a9c0-42cefa20bd78 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.921068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843a59f-b44a-490a-a9c0-42cefa20bd78 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.922510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 520/1054] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:26.927521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570112-ebf1-4a35-936a-fd2bc2d187d9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:26.927935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570112-ebf1-4a35-936a-fd2bc2d187d9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:26.928105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570112-ebf1-4a35-936a-fd2bc2d187d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:26.946678 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ab570112-ebf1-4a35-936a-fd2bc2d187d9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:26.947850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ab570112-ebf1-4a35-936a-fd2bc2d187d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:27.017248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 535/1055] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:27.039265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843a59f-b44a-490a-a9c0-42cefa20bd78 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:27.149668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843a59f-b44a-490a-a9c0-42cefa20bd78 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:27.185463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:27.186046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:27.186325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:27.186602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] PATH_INFO: `/v3/services/image` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:27.187187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:27.188555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:27.197870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:27.198818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:27.205289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 521/1056] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Aug 8 02:20:27 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:27.207619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab570112-ebf1-4a35-936a-fd2bc2d187d9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:27.292994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:27.313634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab570112-ebf1-4a35-936a-fd2bc2d187d9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:27.348411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:27.349020 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:27.349296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:27.349589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:27.350206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] RBAC: Adding query filter params (name=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:27.350506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:27.351933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:27.356951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 536/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:27.362485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:27.417444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:27.467263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5c9f5-23ad-4106-9fbc-42c66927200f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:27.502265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90b03-7e2f-495c-aee3-e482155646fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:27.502876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90b03-7e2f-495c-aee3-e482155646fc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:27.503157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90b03-7e2f-495c-aee3-e482155646fc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:27.503428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90b03-7e2f-495c-aee3-e482155646fc None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:27.504066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90b03-7e2f-495c-aee3-e482155646fc None admin] RBAC: Adding query filter params (type=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:27.504369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90b03-7e2f-495c-aee3-e482155646fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:27.505782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90b03-7e2f-495c-aee3-e482155646fc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:27.511092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 522/1058] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:27.516868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:27.619101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f946628-8617-4985-b3b1-1098b98a77af None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:27.619383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f946628-8617-4985-b3b1-1098b98a77af None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:27.619655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f946628-8617-4985-b3b1-1098b98a77af None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:27.621339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 523/1059] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:27.626948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eb26a-9db3-4357-9bc0-6f62a4ab38b7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:27.627212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eb26a-9db3-4357-9bc0-6f62a4ab38b7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:27.627483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eb26a-9db3-4357-9bc0-6f62a4ab38b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:27.634273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642d1e-80a1-4f5b-aaa7-94df89407a9c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:27.645842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-621eb26a-9db3-4357-9bc0-6f62a4ab38b7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:27.647029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-621eb26a-9db3-4357-9bc0-6f62a4ab38b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:27.672762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:27.673399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:27.673683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:27.673936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:27.674866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:27.675995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:27.692424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:27.697915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 537/1060] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:20:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:27.741493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 524/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:27.763683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:27.875088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1ace-607e-443a-afb6-3114f6bdaab2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:27.908616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:27.909274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:27.909586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:27.909843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:27.921016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:27.925748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:27.926715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:27.927554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 538/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Aug 8 02:20:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:27.935487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eb26a-9db3-4357-9bc0-6f62a4ab38b7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:27.981389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:28.043763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eb26a-9db3-4357-9bc0-6f62a4ab38b7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.078684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.079305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.079584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.079843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.080535 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:28.080836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:28.082262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:28.091013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 525/1063] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Aug 8 02:20:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:28.096729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.159022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:28.203348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2f8d8-f3d8-4a01-b5c1-df6189f5f050 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.238390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.239027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.239308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.239582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.250294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:28.251772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:28.266220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:28.267268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:28.268167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:28.268167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:28.268167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:28.268891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 539/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:28.273568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.381236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf324337-df9e-4d27-9626-e9e5d5dd651e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.384827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:28.417823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31614f5a-0c8b-4b94-9e3f-6208fd0e8234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.418428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31614f5a-0c8b-4b94-9e3f-6208fd0e8234 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.418702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31614f5a-0c8b-4b94-9e3f-6208fd0e8234 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.418968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31614f5a-0c8b-4b94-9e3f-6208fd0e8234 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.419609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31614f5a-0c8b-4b94-9e3f-6208fd0e8234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:28.419905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31614f5a-0c8b-4b94-9e3f-6208fd0e8234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:28.421458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31614f5a-0c8b-4b94-9e3f-6208fd0e8234 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:28.438289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 526/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:28.439601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.524789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b110-980d-4f2a-9bdd-8a37cfc095b2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.525082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b110-980d-4f2a-9bdd-8a37cfc095b2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.525384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b110-980d-4f2a-9bdd-8a37cfc095b2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.526890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 527/1066] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:20:28.531561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4cd69-1e7c-4cc2-aaaa-efc9eea77295 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.531846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4cd69-1e7c-4cc2-aaaa-efc9eea77295 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.532119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4cd69-1e7c-4cc2-aaaa-efc9eea77295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.543557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36a504-fd0f-42ab-92f6-3224d4b3ded6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.550354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-50b4cd69-1e7c-4cc2-aaaa-efc9eea77295 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:28.551548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-50b4cd69-1e7c-4cc2-aaaa-efc9eea77295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:28.557380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:28.583681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.584317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.584656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.584933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.592834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:28.594429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:28.606196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:28.607128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:28.608052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 540/1067] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:28.616424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.629438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 528/1068] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:28.648370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4cd69-1e7c-4cc2-aaaa-efc9eea77295 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.724978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da0c9-df8f-4457-bce3-8058f207e503 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.747658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:28.757304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4cd69-1e7c-4cc2-aaaa-efc9eea77295 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.759910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.760529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.760809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.761082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.761851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:28.762158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:28.763597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:28.786369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 541/1069] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:28.787323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.799637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.800273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.800549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.800821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.811118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:28.815823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:28.816790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:28.818018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 529/1070] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:28.823536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.825171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:28.905669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef73372-fd79-47ac-abff-578749dfe46e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.923795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e1588-1c2b-42ef-ab94-bf26868d7a22 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:28.940183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.940879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.941161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.941457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.951870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:28.953306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:28.958833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:28.959438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:28.959711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:28.959980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:28.960638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:28.960933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:28.962766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:28.968164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:28.969066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:28.969979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:28.969979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:28.969979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:28.969979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 542/1071] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:28.973121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 530/1072] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:28.976936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.978822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:28.999123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:29.069315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:29.090314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27b86-ad05-4537-aefd-9b516d71422e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.093142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f3fe-32da-478b-8aa3-20428ecb80d5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.124381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.124993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.125307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.125562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.126202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:29.126501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.127362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.127862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.128021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.128276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.128552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] PATH_INFO: `/v3/users/d8854ec20ab9435d8b18f88940125147` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.129700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] RBAC: Authorizing `identity:get_user(user_id=d8854ec20ab9435d8b18f88940125147)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.131132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.135479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 531/1073] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/users/d8854ec20ab9435d8b18f88940125147 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:29.139098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:29.141295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 543/1074] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:29.146721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:29.225805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:29.244702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2214a3-b7bc-4e2e-b721-e4ef6c546594 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.260883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51ba5-93c2-4044-b850-c58ef3ab9424 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.282151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.282794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.283082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.283352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.284489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] RBAC: Authorizing `identity:get_project(project_id=11f8ab01a02e41a2822f593234f883dd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.285957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.287619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 532/1075] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:29 2022] GET /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:29.294068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:29.298369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.299057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.299331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.299596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.308918 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.310401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:29.322951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:29.324239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:29.325146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 544/1076] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:29.330628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:29.333746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:29.407607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b205cb-2726-42a6-9159-8f5c9a51189d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.437460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dc04b-51b6-47c6-af6f-a739d61f0edd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.446398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.447058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.447332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.447600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd/users/d8854ec20ab9435d8b18f88940125147/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.450062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8ab01a02e41a2822f593234f883dd, user_id=d8854ec20ab9435d8b18f88940125147, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.451493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.468237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 533/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:20:29 2022] PUT /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd/users/d8854ec20ab9435d8b18f88940125147/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:20:29.475512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5595d-d72d-4dec-ab82-529a22d56418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.476211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5595d-d72d-4dec-ab82-529a22d56418 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.476431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5595d-d72d-4dec-ab82-529a22d56418 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.477038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5595d-d72d-4dec-ab82-529a22d56418 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.477852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5595d-d72d-4dec-ab82-529a22d56418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:29.478168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5595d-d72d-4dec-ab82-529a22d56418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.479637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5595d-d72d-4dec-ab82-529a22d56418 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.493982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 545/1078] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:29.500156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:29.517404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:29.621420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d2e1a-7a5b-4b63-b087-c32964fb55fe None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.670351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ca313-eae5-4bba-bfce-264b6b730857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.671023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ca313-eae5-4bba-bfce-264b6b730857 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.671303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ca313-eae5-4bba-bfce-264b6b730857 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.671578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ca313-eae5-4bba-bfce-264b6b730857 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e0097046a5f7407d84884097fcfc4ba3/roles/2410df59e1c247df95d53a3043e19234` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.673748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ca313-eae5-4bba-bfce-264b6b730857 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=e0097046a5f7407d84884097fcfc4ba3, role_id=2410df59e1c247df95d53a3043e19234)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:29.675191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ca313-eae5-4bba-bfce-264b6b730857 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:29.689299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 534/1079] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:20:29 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/e0097046a5f7407d84884097fcfc4ba3/roles/2410df59e1c247df95d53a3043e19234 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:20:29.723358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3c65-637a-4f14-b4cf-b28d64bfec9d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.723735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3c65-637a-4f14-b4cf-b28d64bfec9d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.723912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3c65-637a-4f14-b4cf-b28d64bfec9d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.725522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 546/1080] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:20:29.731317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e99c-5c0d-4614-bacd-340fb9c22627 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.731549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e99c-5c0d-4614-bacd-340fb9c22627 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.731829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e99c-5c0d-4614-bacd-340fb9c22627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:29.752382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0a76e99c-5c0d-4614-bacd-340fb9c22627 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:29.753765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0a76e99c-5c0d-4614-bacd-340fb9c22627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:29.829987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 535/1081] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:29.853744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3c65-637a-4f14-b4cf-b28d64bfec9d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:29.920040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:29.963490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3c65-637a-4f14-b4cf-b28d64bfec9d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:29.998014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:29.998548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:29.998825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:29.999095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:30.067151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:30.068604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:30.129243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:30.172629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 547/1082] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:30.178459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76e99c-5c0d-4614-bacd-340fb9c22627 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:30.181313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:30.281707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76e99c-5c0d-4614-bacd-340fb9c22627 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:30.315960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c1df8-571f-484f-bda9-72ed94b1ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:30.316596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1df8-571f-484f-bda9-72ed94b1ed33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:30.316904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1df8-571f-484f-bda9-72ed94b1ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:30.317176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1df8-571f-484f-bda9-72ed94b1ed33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:30.328009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c1df8-571f-484f-bda9-72ed94b1ed33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:30.329503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c1df8-571f-484f-bda9-72ed94b1ed33 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9d4c1df8-571f-484f-bda9-72ed94b1ed33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:30.344441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:30.345730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:30.346625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:30.346625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:30.346625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:30.347218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 536/1083] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:30.351625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:30.462922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47dbf-4575-4ea9-a543-4645c887c073 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:30.497038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbc40e-c487-40ce-89c7-af91528b6591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:30.497671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbc40e-c487-40ce-89c7-af91528b6591 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:30.497949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbc40e-c487-40ce-89c7-af91528b6591 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:30.498221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbc40e-c487-40ce-89c7-af91528b6591 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:30.498859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbc40e-c487-40ce-89c7-af91528b6591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:30.499165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbc40e-c487-40ce-89c7-af91528b6591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:30.500536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbc40e-c487-40ce-89c7-af91528b6591 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:30.512633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 548/1084] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:31.476477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d49207-dec7-4572-9436-63501b4f9608 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:31.477070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d49207-dec7-4572-9436-63501b4f9608 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:31.477238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d49207-dec7-4572-9436-63501b4f9608 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:31.478644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 537/1085] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:31.484116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f287d-a3f5-49c9-86f1-623bfc080d1b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:31.484514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f287d-a3f5-49c9-86f1-623bfc080d1b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:31.484697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f287d-a3f5-49c9-86f1-623bfc080d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:31.503685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-db2f287d-a3f5-49c9-86f1-623bfc080d1b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:31.504870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-db2f287d-a3f5-49c9-86f1-623bfc080d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:31.522500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:31.573610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 549/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:31.596770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d49207-dec7-4572-9436-63501b4f9608 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:31.652884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0febb8b-655d-4e1a-9527-c04f4a9f1469 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:31.653154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0febb8b-655d-4e1a-9527-c04f4a9f1469 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:31.653489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0febb8b-655d-4e1a-9527-c04f4a9f1469 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:31.654831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 550/1087] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:31.658186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:31.659871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32000736-db5c-40e5-83cb-842b2ac7980a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:31.660187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32000736-db5c-40e5-83cb-842b2ac7980a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:31.660408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32000736-db5c-40e5-83cb-842b2ac7980a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:31.679000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-32000736-db5c-40e5-83cb-842b2ac7980a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:31.680336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-32000736-db5c-40e5-83cb-842b2ac7980a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:31.704313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d49207-dec7-4572-9436-63501b4f9608 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:31.738259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:31.738809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:31.739071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:31.739336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:31.749587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 551/1088] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:31.749909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:31.754201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:31.755152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:31.756376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 538/1089] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:31.761620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32000736-db5c-40e5-83cb-842b2ac7980a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:31.772637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:31.844092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:31.863915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32000736-db5c-40e5-83cb-842b2ac7980a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:31.875815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933d62-5d61-48b2-88ca-e5058c8069da None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:31.889812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:31.898155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:31.898798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:31.899112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:31.899426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:31.900084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:31.900385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:31.901856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:31.909951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 552/1090] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:31.912213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:31.912849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:31.913129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:31.913432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:31.915877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:31.924706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:31.929423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:31.930511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:31.931333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 539/1091] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Aug 8 02:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:31.937056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.019156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d020140-c544-445a-9817-90955e19ab81 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.035863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4e416-dcb3-45a6-bb12-a0cefd9b3702 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.052155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.052797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.053061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.053329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] PATH_INFO: `/v3/users/d8854ec20ab9435d8b18f88940125147` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.054496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d8854ec20ab9435d8b18f88940125147)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.056072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.057710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 553/1092] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:31 2022] GET /identity/v3/users/d8854ec20ab9435d8b18f88940125147 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:32.063694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.070567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.071184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.071469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.071733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.072397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:32.072695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.074464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.080030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:32.083291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 540/1093] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Aug 8 02:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:32.089003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.124790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:32.170357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529806a3-1a2b-4a07-9d25-541e3ed4e5f5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.190062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db620-e0f0-4a8c-800a-77d7deb00219 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.203927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.204532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.204806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.205073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.222844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.223500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.223778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.224060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.234542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.236016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:32.249891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:32.250843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:32.251715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:32.251715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:32.251715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:32.251715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 541/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:32.256814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.274459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.275863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.289281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:32.343270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:32.355716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd5cbf-1f8f-4c5a-9485-1b010a41e080 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.373981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 554/1095] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:20:32.379937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.388912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.389552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.389831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.390104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.390743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:32.391048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.392417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.408830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 542/1096] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:32.414664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.478436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461689dc-c7d8-45d0-887f-99911057f406 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.492344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:32.513723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.514053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80772c9-1f92-4dad-bb44-22ec666500b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.514460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.514615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.514880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.516102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8ab01a02e41a2822f593234f883dd)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.518343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.520058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 555/1097] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:32.526414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.548817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.549479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.549756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.550024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.557904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.559358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:20:32.570703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:32.571646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:32.572703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 543/1098] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:20:32.577991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.588460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:32.627526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922e1c1-d3ad-44f0-8197-a619361ba249 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.663472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.664172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.664458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.664744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.665482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=11f8ab01a02e41a2822f593234f883dd, user.id=d8854ec20ab9435d8b18f88940125147) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:32.665797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.667228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.673001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 556/1099] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/role_assignments?user.id=d8854ec20ab9435d8b18f88940125147&scope.project.id=11f8ab01a02e41a2822f593234f883dd&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:32.677635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad25f4-0344-48c7-b791-f9f8fca748d5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.715928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.716556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.716833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.717107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.717896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:32.718204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.719717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:32.739965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 544/1100] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:20:32.746375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:32.801286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:32.863307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d5a4-d19b-40fc-94ab-924ae2bbd183 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:32.897566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:32.898183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:32.898510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:32.898773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:32.966841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:32.968284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:33.013889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:33.069469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 557/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:33.075580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:33.145933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:33.181610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd10c-a37c-4d08-809e-9ffce80fd7df None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:33.214966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:33.215584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:33.215855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:33.216123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:33.226041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:33.227959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:20:33.242060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:33.243033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:20:33.243935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:20:33.243935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:20:33.243935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:33.243935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 545/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:33.249238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:33.345104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86051a-fdac-4e3f-a650-644a3e900818 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:33.380131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:33.380774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:33.381051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:33.381321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:33.382001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:33.382303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:33.383759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:33.395525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 558/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:33.401466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:33.504615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff16f-77b7-4b97-9fef-5bd087948593 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:33.521716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:33.539647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:33.540275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:33.540563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:33.540835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:33.547467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:33.548914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:20:33.560025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:33.560879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:33.561799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 546/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:33.567231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:33.571796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:33.675700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ef5cf-5187-47b9-9e79-0141f0710b6f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:33.711369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743c353-f4c3-47f4-8cbc-abbaf6d189f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:33.712035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c353-f4c3-47f4-8cbc-abbaf6d189f8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:33.712315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c353-f4c3-47f4-8cbc-abbaf6d189f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:33.712583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c353-f4c3-47f4-8cbc-abbaf6d189f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:33.713280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743c353-f4c3-47f4-8cbc-abbaf6d189f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:33.713598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743c353-f4c3-47f4-8cbc-abbaf6d189f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:33.715067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743c353-f4c3-47f4-8cbc-abbaf6d189f8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:33.727501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 559/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:33.733800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:33.840520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784be4-864c-4c1e-9475-0b057100ec87 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:33.879120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452338c-84a6-40df-9391-129428b18741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:33.879656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452338c-84a6-40df-9391-129428b18741 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:33.879939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452338c-84a6-40df-9391-129428b18741 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:33.880211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452338c-84a6-40df-9391-129428b18741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:33.880945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452338c-84a6-40df-9391-129428b18741 None admin] RBAC: Adding query filter params (role.id=2410df59e1c247df95d53a3043e19234, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=e0097046a5f7407d84884097fcfc4ba3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:33.881254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452338c-84a6-40df-9391-129428b18741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:33.882749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452338c-84a6-40df-9391-129428b18741 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:33.888876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 547/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:33 2022] GET /identity/v3/role_assignments?user.id=e0097046a5f7407d84884097fcfc4ba3&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=2410df59e1c247df95d53a3043e19234 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:34.681316 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4795-7f9e-488c-be9e-79b4cc3f3f9e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:34.681862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4795-7f9e-488c-be9e-79b4cc3f3f9e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:34.682178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4795-7f9e-488c-be9e-79b4cc3f3f9e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:34.683567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 560/1107] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:34.688896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92b5a4-4ec4-4b2e-862e-c69867c5afed None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:34.689336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92b5a4-4ec4-4b2e-862e-c69867c5afed None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:34.689493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92b5a4-4ec4-4b2e-862e-c69867c5afed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:34.708255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8a92b5a4-4ec4-4b2e-862e-c69867c5afed None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:34.709420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8a92b5a4-4ec4-4b2e-862e-c69867c5afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:34.745188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:34.777924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 548/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:34.803100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4795-7f9e-488c-be9e-79b4cc3f3f9e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:34.880404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:34.921080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4795-7f9e-488c-be9e-79b4cc3f3f9e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:34.956043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a093d9-486f-482f-86d4-cb1a50edac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:34.956663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a093d9-486f-482f-86d4-cb1a50edac51 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:34.956933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a093d9-486f-482f-86d4-cb1a50edac51 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:34.957200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a093d9-486f-482f-86d4-cb1a50edac51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:34.958374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a093d9-486f-482f-86d4-cb1a50edac51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:34.959803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a093d9-486f-482f-86d4-cb1a50edac51 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:34.961401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 561/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:34.967927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92b5a4-4ec4-4b2e-862e-c69867c5afed None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:35.077615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92b5a4-4ec4-4b2e-862e-c69867c5afed None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:35.112477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3ee6-8740-4695-9030-e04d71f0c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:35.113069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3ee6-8740-4695-9030-e04d71f0c625 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:35.113343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3ee6-8740-4695-9030-e04d71f0c625 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:35.113611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3ee6-8740-4695-9030-e04d71f0c625 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:35.114266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3ee6-8740-4695-9030-e04d71f0c625 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:35.115694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3ee6-8740-4695-9030-e04d71f0c625 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:35.141627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 549/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:20:34 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:37.160268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e61c-439a-45c8-90fd-34e455bf6a80 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:37.160823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e61c-439a-45c8-90fd-34e455bf6a80 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:37.160823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e61c-439a-45c8-90fd-34e455bf6a80 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:37.163078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 562/1111] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:37.171256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e175f84-82d9-4b9c-9900-ecfa4c1cb47a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:37.171724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e175f84-82d9-4b9c-9900-ecfa4c1cb47a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:37.171815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e175f84-82d9-4b9c-9900-ecfa4c1cb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:37.192369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1e175f84-82d9-4b9c-9900-ecfa4c1cb47a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:37.193589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e175f84-82d9-4b9c-9900-ecfa4c1cb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:37.218033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:37.268641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 550/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:37.302094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e61c-439a-45c8-90fd-34e455bf6a80 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:37.419972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e61c-439a-45c8-90fd-34e455bf6a80 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:37.450271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:37.456328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:37.456951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:37.457226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:37.457530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] PATH_INFO: `/v3/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:37.458977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] RBAC: Authorizing `identity:get_role(role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:37.460343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:37.461783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 563/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:37 2022] GET /identity/v3/roles/d138e21392054605846b1a7ee19e3814 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:37.468136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e175f84-82d9-4b9c-9900-ecfa4c1cb47a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:37.588813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e175f84-82d9-4b9c-9900-ecfa4c1cb47a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:37.627473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:37.628110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:37.628402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:37.628673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] PATH_INFO: `/v3/users/59f90dceec7b4d0b8908459d7f53da39` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:37.642357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=59f90dceec7b4d0b8908459d7f53da39)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:37.643814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:37.645431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 551/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:37 2022] GET /identity/v3/users/59f90dceec7b4d0b8908459d7f53da39 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:37.651607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:37.756150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c88ba-b5db-4c83-bdbe-f11914304520 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:37.793385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:37.794003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:37.794281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:37.794527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:37.865202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:37.867929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:37.869492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:37.971999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 564/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:37.979967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:37.999295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:38.081065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f639f-c400-41f6-9bcb-d6c21db8c3d5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:38.115323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d1072-87f6-4c1c-b037-96b7871d4ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:38.115929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1072-87f6-4c1c-b037-96b7871d4ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:38.116204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1072-87f6-4c1c-b037-96b7871d4ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:38.116454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1072-87f6-4c1c-b037-96b7871d4ff9 None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:38.117666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d1072-87f6-4c1c-b037-96b7871d4ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8ab01a02e41a2822f593234f883dd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:38.119093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d1072-87f6-4c1c-b037-96b7871d4ff9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:38.120717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 552/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:37 2022] GET /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:38.127633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:38.240692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:38.243962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3e295-7fba-45bb-ada2-8c22967e3e3e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:38.285900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7a42a-8241-445b-870a-eaec74af661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:38.286498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a42a-8241-445b-870a-eaec74af661d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:38.286772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a42a-8241-445b-870a-eaec74af661d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:38.287034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a42a-8241-445b-870a-eaec74af661d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:38.287755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a42a-8241-445b-870a-eaec74af661d None admin] RBAC: Adding query filter params (role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=11f8ab01a02e41a2822f593234f883dd, user.id=59f90dceec7b4d0b8908459d7f53da39) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:38.288060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a42a-8241-445b-870a-eaec74af661d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:38.289828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a42a-8241-445b-870a-eaec74af661d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:38.295306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 565/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:38 2022] GET /identity/v3/role_assignments?user.id=59f90dceec7b4d0b8908459d7f53da39&scope.project.id=11f8ab01a02e41a2822f593234f883dd&role.id=d138e21392054605846b1a7ee19e3814 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:40.247726 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e6aa-0542-4856-badf-6bffbb0a8e18 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:40.248290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e6aa-0542-4856-badf-6bffbb0a8e18 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:40.248290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e6aa-0542-4856-badf-6bffbb0a8e18 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:40.249657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 553/1118] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:40.256100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079067-b0d6-4b76-987c-4e1ec41eaf22 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:40.256774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079067-b0d6-4b76-987c-4e1ec41eaf22 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:40.256954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079067-b0d6-4b76-987c-4e1ec41eaf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:40.276075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2c079067-b0d6-4b76-987c-4e1ec41eaf22 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:40.277257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2c079067-b0d6-4b76-987c-4e1ec41eaf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:40.352766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 566/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:40.380634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e6aa-0542-4856-badf-6bffbb0a8e18 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:40.472470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:40.496405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e6aa-0542-4856-badf-6bffbb0a8e18 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:40.532030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:40.532567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:40.532866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:40.533134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] PATH_INFO: `/v3/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:40.534656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] RBAC: Authorizing `identity:get_role(role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:40.536049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:40.537389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 554/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:40 2022] GET /identity/v3/roles/d138e21392054605846b1a7ee19e3814 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:40.544797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c079067-b0d6-4b76-987c-4e1ec41eaf22 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:40.643004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:40.650529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c079067-b0d6-4b76-987c-4e1ec41eaf22 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:40.687167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:40.687789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:40.688063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:40.688334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] PATH_INFO: `/v3/users/59f90dceec7b4d0b8908459d7f53da39` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:40.689529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] RBAC: Authorizing `identity:get_user(user_id=59f90dceec7b4d0b8908459d7f53da39)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:40.690952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:40.692545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 567/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:40 2022] GET /identity/v3/users/59f90dceec7b4d0b8908459d7f53da39 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:40.699952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:40.829936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09501-d9e6-40ee-b3a1-1b287718b75b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:40.865058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ac10b-fd1d-4b3a-8e58-5cf1d70ef327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:40.865713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac10b-fd1d-4b3a-8e58-5cf1d70ef327 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:40.865986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac10b-fd1d-4b3a-8e58-5cf1d70ef327 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:40.866255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac10b-fd1d-4b3a-8e58-5cf1d70ef327 None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:40.867597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ac10b-fd1d-4b3a-8e58-5cf1d70ef327 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8ab01a02e41a2822f593234f883dd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:40.869052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ac10b-fd1d-4b3a-8e58-5cf1d70ef327 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:40.870727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 555/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:40 2022] GET /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:40.877519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:40.991695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae901f-7f80-44a9-83f2-43d59c419c42 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:41.029895 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a001e9f-c1b3-451f-80c0-a26fd7112ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:41.030557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a001e9f-c1b3-451f-80c0-a26fd7112ef0 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:41.030840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a001e9f-c1b3-451f-80c0-a26fd7112ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:41.031115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a001e9f-c1b3-451f-80c0-a26fd7112ef0 None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd/users/59f90dceec7b4d0b8908459d7f53da39/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:41.033295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a001e9f-c1b3-451f-80c0-a26fd7112ef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8ab01a02e41a2822f593234f883dd, user_id=59f90dceec7b4d0b8908459d7f53da39, role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:41.034776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a001e9f-c1b3-451f-80c0-a26fd7112ef0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:41.051476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 568/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:20:40 2022] PUT /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd/users/59f90dceec7b4d0b8908459d7f53da39/roles/d138e21392054605846b1a7ee19e3814 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:20:43.065053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0117-4121-443a-92b3-510e5db609b5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:43.065643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0117-4121-443a-92b3-510e5db609b5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:43.065643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0117-4121-443a-92b3-510e5db609b5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:43.066998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 556/1124] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:43.072513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fbc7-a4d7-4166-a9fe-75585d9b17e6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:43.072927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fbc7-a4d7-4166-a9fe-75585d9b17e6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:43.073013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fbc7-a4d7-4166-a9fe-75585d9b17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:43.094013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bad0fbc7-a4d7-4166-a9fe-75585d9b17e6 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:43.095193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bad0fbc7-a4d7-4166-a9fe-75585d9b17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:43.113587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:43.176346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 569/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:43.200920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0117-4121-443a-92b3-510e5db609b5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:43.226672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:43.319526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0117-4121-443a-92b3-510e5db609b5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:43.356062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:43.356680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:43.356957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:43.357232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] PATH_INFO: `/v3/roles/d138e21392054605846b1a7ee19e3814` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:43.358751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] RBAC: Authorizing `identity:get_role(role_id=d138e21392054605846b1a7ee19e3814)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:43.360153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:43.361512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 557/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:43 2022] GET /identity/v3/roles/d138e21392054605846b1a7ee19e3814 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:43.368363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fbc7-a4d7-4166-a9fe-75585d9b17e6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:43.472227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fbc7-a4d7-4166-a9fe-75585d9b17e6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:43.508511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:43.509142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:43.509427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:43.509719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] PATH_INFO: `/v3/users/59f90dceec7b4d0b8908459d7f53da39` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:43.510958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] RBAC: Authorizing `identity:get_user(user_id=59f90dceec7b4d0b8908459d7f53da39)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:43.512393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:43.514001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 570/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:43 2022] GET /identity/v3/users/59f90dceec7b4d0b8908459d7f53da39 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:43.520074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:43.633394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:43.652906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bdcc0-4a7b-4fc5-9d1b-291b4ee00a26 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:43.692235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:43.692829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:43.693107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:43.693413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:43.761637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:43.763153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:43.861116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:43.877331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 558/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:43.885644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:43.908913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:44.007564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d193f-fa07-42c2-bd4b-42827b88614a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:44.043327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd31455-6035-44f6-8cba-f03991cf8317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:44.043948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31455-6035-44f6-8cba-f03991cf8317 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:44.044230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31455-6035-44f6-8cba-f03991cf8317 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:44.044501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31455-6035-44f6-8cba-f03991cf8317 None admin] PATH_INFO: `/v3/projects/11f8ab01a02e41a2822f593234f883dd` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:44.045788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd31455-6035-44f6-8cba-f03991cf8317 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8ab01a02e41a2822f593234f883dd)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:44.047227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd31455-6035-44f6-8cba-f03991cf8317 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:44.048898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 571/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:43 2022] GET /identity/v3/projects/11f8ab01a02e41a2822f593234f883dd => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:44.056169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:44.166936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d51f6-c394-4db9-9b01-6ca325c1d699 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:44.201904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3e0c9-b200-4624-8db8-63ef4892a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:44.202488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e0c9-b200-4624-8db8-63ef4892a787 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:44.202758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e0c9-b200-4624-8db8-63ef4892a787 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:44.203026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e0c9-b200-4624-8db8-63ef4892a787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:44.203737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3e0c9-b200-4624-8db8-63ef4892a787 None admin] RBAC: Adding query filter params (role.id=d138e21392054605846b1a7ee19e3814, scope.project.id=11f8ab01a02e41a2822f593234f883dd, user.id=59f90dceec7b4d0b8908459d7f53da39) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:44.204043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3e0c9-b200-4624-8db8-63ef4892a787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:44.205552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3e0c9-b200-4624-8db8-63ef4892a787 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:44.211327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 559/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:44 2022] GET /identity/v3/role_assignments?user.id=59f90dceec7b4d0b8908459d7f53da39&scope.project.id=11f8ab01a02e41a2822f593234f883dd&role.id=d138e21392054605846b1a7ee19e3814 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:46.217568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1e25-f95c-4e6d-aa98-15e09e5f81fa None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:46.218214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1e25-f95c-4e6d-aa98-15e09e5f81fa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:46.218214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1e25-f95c-4e6d-aa98-15e09e5f81fa None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:46.219467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 572/1131] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:46.225785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93e67-fee1-408d-8c7c-386b1b0c209e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:46.226525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93e67-fee1-408d-8c7c-386b1b0c209e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:46.226653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93e67-fee1-408d-8c7c-386b1b0c209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:46.248408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7cd93e67-fee1-408d-8c7c-386b1b0c209e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:46.250279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7cd93e67-fee1-408d-8c7c-386b1b0c209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:46.306587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:46.328005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 560/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:46.351144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac1e25-f95c-4e6d-aa98-15e09e5f81fa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:46.446360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:46.460712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac1e25-f95c-4e6d-aa98-15e09e5f81fa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:46.497834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f301d72-a81b-414d-b91b-3fd30cd32442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:46.498383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301d72-a81b-414d-b91b-3fd30cd32442 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:46.498658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301d72-a81b-414d-b91b-3fd30cd32442 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:46.498925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301d72-a81b-414d-b91b-3fd30cd32442 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:46.500146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f301d72-a81b-414d-b91b-3fd30cd32442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:46.501592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f301d72-a81b-414d-b91b-3fd30cd32442 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:46.503191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 573/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:46.509990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd93e67-fee1-408d-8c7c-386b1b0c209e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:46.645688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd93e67-fee1-408d-8c7c-386b1b0c209e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:46.682310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bb9bd-9d0c-41c3-8c2e-1bc915269c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:46.682908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bb9bd-9d0c-41c3-8c2e-1bc915269c63 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:46.683182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bb9bd-9d0c-41c3-8c2e-1bc915269c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:46.683451 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bb9bd-9d0c-41c3-8c2e-1bc915269c63 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:46.684084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bb9bd-9d0c-41c3-8c2e-1bc915269c63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:46.685561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bb9bd-9d0c-41c3-8c2e-1bc915269c63 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:46.718158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 561/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:20:46 2022] POST /identity/v3/projects => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:48.720690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729004-96b9-42ba-b3a3-f3ec6d5d81d5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:48.721247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729004-96b9-42ba-b3a3-f3ec6d5d81d5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:48.721247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729004-96b9-42ba-b3a3-f3ec6d5d81d5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:48.722615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 574/1135] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:48.728004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59261de8-2afe-4a00-b1d6-168f5d3d1e41 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:48.728438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59261de8-2afe-4a00-b1d6-168f5d3d1e41 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:48.728547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59261de8-2afe-4a00-b1d6-168f5d3d1e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:48.748231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-59261de8-2afe-4a00-b1d6-168f5d3d1e41 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:48.749407 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-59261de8-2afe-4a00-b1d6-168f5d3d1e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:48.776383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:48.818636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 562/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:48.842819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729004-96b9-42ba-b3a3-f3ec6d5d81d5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:48.964302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729004-96b9-42ba-b3a3-f3ec6d5d81d5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:49.006664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb289b42-fce1-4c1b-88cd-c8c1e680b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:49.007290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb289b42-fce1-4c1b-88cd-c8c1e680b927 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:49.007565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb289b42-fce1-4c1b-88cd-c8c1e680b927 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:49.007836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb289b42-fce1-4c1b-88cd-c8c1e680b927 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:49.009195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb289b42-fce1-4c1b-88cd-c8c1e680b927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:49.010671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb289b42-fce1-4c1b-88cd-c8c1e680b927 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:49.012251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 575/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:20:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:49.018320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59261de8-2afe-4a00-b1d6-168f5d3d1e41 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:49.135892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59261de8-2afe-4a00-b1d6-168f5d3d1e41 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:49.180778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8e3f6-31c0-4277-8fd9-f1cfa9c052f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:49.181408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e3f6-31c0-4277-8fd9-f1cfa9c052f2 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:49.181696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e3f6-31c0-4277-8fd9-f1cfa9c052f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:49.181968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e3f6-31c0-4277-8fd9-f1cfa9c052f2 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:49.182614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8e3f6-31c0-4277-8fd9-f1cfa9c052f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:49.184080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8e3f6-31c0-4277-8fd9-f1cfa9c052f2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:49.213931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 563/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:20:49 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:20:51.237181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82371a-4c87-44e0-abe7-b231a4382314 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:51.238155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82371a-4c87-44e0-abe7-b231a4382314 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:51.238155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82371a-4c87-44e0-abe7-b231a4382314 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:51.240198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 576/1139] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:51.246760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3ea8-dc7c-4cb1-b88a-567270f01040 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:51.247475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3ea8-dc7c-4cb1-b88a-567270f01040 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:51.247645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3ea8-dc7c-4cb1-b88a-567270f01040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:51.271806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d3ba3ea8-dc7c-4cb1-b88a-567270f01040 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:51.272989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d3ba3ea8-dc7c-4cb1-b88a-567270f01040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:51.288743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:51.345930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 564/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:51.370254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82371a-4c87-44e0-abe7-b231a4382314 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:51.404585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:51.502470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82371a-4c87-44e0-abe7-b231a4382314 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:51.544904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:51.545888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:51.546312 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:51.546738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:51.561832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:51.566524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:51.567606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:51.568850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 577/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:51.574294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3ea8-dc7c-4cb1-b88a-567270f01040 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:51.677308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3ea8-dc7c-4cb1-b88a-567270f01040 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:51.712466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:51.713059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:51.713335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:51.713632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:51.714294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:51.714587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:51.715958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:51.724165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 565/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:51.730374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:51.824814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:51.843442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb81a0-5cd8-41d0-b17d-ac1fde7b5a62 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:51.880112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:51.880730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:51.881013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:51.881280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] PATH_INFO: `/v3/users/96c91ce5e28548e58a39bae1edcd5067` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:51.895056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] RBAC: Authorizing `identity:get_user(user_id=96c91ce5e28548e58a39bae1edcd5067)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:51.896497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:51.898146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 578/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:51 2022] GET /identity/v3/users/96c91ce5e28548e58a39bae1edcd5067 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:51.904845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:51.923003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:52.019164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7671-4c01-4ec3-a564-a0f363f780be None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:52.056158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:52.057040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:52.057433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:52.057837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:52.131657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:52.133035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:52.146441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:52.233167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 566/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:52.239273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:52.352325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a67b9-ce72-4e29-90c2-ae1dfda51f95 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:52.389464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4fa36-c91c-4f85-b4ec-063474cc18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:52.390041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4fa36-c91c-4f85-b4ec-063474cc18c1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:52.390316 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4fa36-c91c-4f85-b4ec-063474cc18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:52.390577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4fa36-c91c-4f85-b4ec-063474cc18c1 None admin] PATH_INFO: `/v3/projects/9f7047b24ead4adf843895460a640e4c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:52.391683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4fa36-c91c-4f85-b4ec-063474cc18c1 None admin] RBAC: Authorizing `identity:get_project(project_id=9f7047b24ead4adf843895460a640e4c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:52.393107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4fa36-c91c-4f85-b4ec-063474cc18c1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:52.394772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 579/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:52 2022] GET /identity/v3/projects/9f7047b24ead4adf843895460a640e4c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:52.402850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:52.502535 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cca00f-d8a5-4aba-b342-77cc6edd8f47 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:52.516577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:52.541084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0db8ed-f223-41ad-b79f-426a4717a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:52.541722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0db8ed-f223-41ad-b79f-426a4717a0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:52.541999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0db8ed-f223-41ad-b79f-426a4717a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:52.542270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0db8ed-f223-41ad-b79f-426a4717a0b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:52.543021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0db8ed-f223-41ad-b79f-426a4717a0b9 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=9f7047b24ead4adf843895460a640e4c, user.id=96c91ce5e28548e58a39bae1edcd5067) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:52.543319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0db8ed-f223-41ad-b79f-426a4717a0b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:52.544752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0db8ed-f223-41ad-b79f-426a4717a0b9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:52.550278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 567/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:52 2022] GET /identity/v3/role_assignments?user.id=96c91ce5e28548e58a39bae1edcd5067&scope.project.id=9f7047b24ead4adf843895460a640e4c&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:54.495319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8244cc-ce60-4479-8dfc-a44d1116e610 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:54.495880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8244cc-ce60-4479-8dfc-a44d1116e610 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:54.495880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8244cc-ce60-4479-8dfc-a44d1116e610 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:54.498026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 580/1147] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:54.506827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b623e-178d-4a06-9db9-be842b8f1d9f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:54.507232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b623e-178d-4a06-9db9-be842b8f1d9f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:54.507458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b623e-178d-4a06-9db9-be842b8f1d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:54.526880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-383b623e-178d-4a06-9db9-be842b8f1d9f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:54.528054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-383b623e-178d-4a06-9db9-be842b8f1d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:54.599380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 568/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:20:54.622900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8244cc-ce60-4479-8dfc-a44d1116e610 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:54.640469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:54.750642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8244cc-ce60-4479-8dfc-a44d1116e610 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:54.790785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:54.791422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:54.791705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:54.791976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:54.802209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:54.807054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:54.808089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:20:54.808993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 581/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:54.816028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b623e-178d-4a06-9db9-be842b8f1d9f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:54.922580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b623e-178d-4a06-9db9-be842b8f1d9f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:54.929869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:54.958556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:54.959159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:54.959446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:54.959717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:54.960383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:54.960694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:54.962267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:54.970376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 569/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:54.977338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:55.061511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:55.093837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb39d-6356-40d3-88b8-f5a968e5b2fe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:55.125993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:55.126615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:55.126892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:55.127165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] PATH_INFO: `/v3/users/96c91ce5e28548e58a39bae1edcd5067` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:55.128266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] RBAC: Authorizing `identity:get_user(user_id=96c91ce5e28548e58a39bae1edcd5067)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:55.129768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:55.131363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 582/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:54 2022] GET /identity/v3/users/96c91ce5e28548e58a39bae1edcd5067 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:55.140244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:55.246010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1a75-89ec-4a63-847c-6c15629e5458 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:55.291575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52f190-5b7b-457d-b877-781ad63455c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:55.292195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f190-5b7b-457d-b877-781ad63455c3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:55.292476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f190-5b7b-457d-b877-781ad63455c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:55.292745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f190-5b7b-457d-b877-781ad63455c3 None admin] PATH_INFO: `/v3/projects/9f7047b24ead4adf843895460a640e4c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:55.293940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52f190-5b7b-457d-b877-781ad63455c3 None admin] RBAC: Authorizing `identity:get_project(project_id=9f7047b24ead4adf843895460a640e4c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:55.295417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52f190-5b7b-457d-b877-781ad63455c3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:55.297058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 570/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:55 2022] GET /identity/v3/projects/9f7047b24ead4adf843895460a640e4c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:55.303118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:55.434645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d76a-c853-4595-bc85-a521bcee9ace None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:55.471294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476146f-94b9-4d71-a880-fe9a37ba5028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:55.471953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476146f-94b9-4d71-a880-fe9a37ba5028 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:55.472230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476146f-94b9-4d71-a880-fe9a37ba5028 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:55.472499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476146f-94b9-4d71-a880-fe9a37ba5028 None admin] PATH_INFO: `/v3/projects/9f7047b24ead4adf843895460a640e4c/users/96c91ce5e28548e58a39bae1edcd5067/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:55.474677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476146f-94b9-4d71-a880-fe9a37ba5028 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f7047b24ead4adf843895460a640e4c, user_id=96c91ce5e28548e58a39bae1edcd5067, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:55.476117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476146f-94b9-4d71-a880-fe9a37ba5028 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:55.489374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:55.496419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 583/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:20:55 2022] PUT /identity/v3/projects/9f7047b24ead4adf843895460a640e4c/users/96c91ce5e28548e58a39bae1edcd5067/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:20:57.492066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5d30-4863-4f63-bdc2-4a6561af9f78 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:57.493118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5d30-4863-4f63-bdc2-4a6561af9f78 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:57.493118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5d30-4863-4f63-bdc2-4a6561af9f78 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:57.494530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 571/1154] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:57.502349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1062c5b-f9ad-42e7-8401-f46b1d1806fb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:57.502791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1062c5b-f9ad-42e7-8401-f46b1d1806fb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:57.502904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1062c5b-f9ad-42e7-8401-f46b1d1806fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:57.524137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d1062c5b-f9ad-42e7-8401-f46b1d1806fb None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:57.525415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d1062c5b-f9ad-42e7-8401-f46b1d1806fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:57.597220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 584/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:20:57.627413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb5d30-4863-4f63-bdc2-4a6561af9f78 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:57.667591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:57.738537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb5d30-4863-4f63-bdc2-4a6561af9f78 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:57.775471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:57.776016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:57.776294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:57.776564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:57.786479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:20:57.791279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:20:57.792294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:20:57.793262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:20:57.797299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 572/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:20:57.799111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1062c5b-f9ad-42e7-8401-f46b1d1806fb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:57.907110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1062c5b-f9ad-42e7-8401-f46b1d1806fb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:57.934278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:57.943299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:57.943906 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:57.944192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:57.944469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:57.945120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:57.945415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:57.946988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:57.955510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 585/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:57.962131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:58.067920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:58.077148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77def09-4d0e-400a-befe-ab433f7580c5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:58.123223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:58.123830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:58.124112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:58.124382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] PATH_INFO: `/v3/users/96c91ce5e28548e58a39bae1edcd5067` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:58.125642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] RBAC: Authorizing `identity:get_user(user_id=96c91ce5e28548e58a39bae1edcd5067)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:58.127090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:58.128659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 573/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:20:57 2022] GET /identity/v3/users/96c91ce5e28548e58a39bae1edcd5067 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:58.136773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:58.245144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ef1d-2f00-45dd-8379-c92552886b8b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:58.287217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:58.288137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:58.288510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:58.288960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:58.350379 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:58.361641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:58.363091 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:58.483762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 586/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:20:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:20:58.493851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:58.613328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566098-130e-4814-937b-70e6125f0d12 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:58.664321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d47e63-a084-4062-bcd6-8a8848a4f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:58.665414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47e63-a084-4062-bcd6-8a8848a4f9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:58.665951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47e63-a084-4062-bcd6-8a8848a4f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:58.666453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47e63-a084-4062-bcd6-8a8848a4f9a3 None admin] PATH_INFO: `/v3/projects/9f7047b24ead4adf843895460a640e4c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:58.668502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d47e63-a084-4062-bcd6-8a8848a4f9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=9f7047b24ead4adf843895460a640e4c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:58.670984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d47e63-a084-4062-bcd6-8a8848a4f9a3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:58.672799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 574/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:20:58 2022] GET /identity/v3/projects/9f7047b24ead4adf843895460a640e4c => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:20:58.679607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:58.789733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:58.800385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4dfaf-4f67-47cc-adad-80e1b3e652e0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:58.840247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d5ae4-335f-4622-bc80-15e2dedb7ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:58.840842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5ae4-335f-4622-bc80-15e2dedb7ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:58.841114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5ae4-335f-4622-bc80-15e2dedb7ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:58.841413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5ae4-335f-4622-bc80-15e2dedb7ce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:58.842123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d5ae4-335f-4622-bc80-15e2dedb7ce2 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=9f7047b24ead4adf843895460a640e4c, user.id=96c91ce5e28548e58a39bae1edcd5067) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:20:58.842426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d5ae4-335f-4622-bc80-15e2dedb7ce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:58.843871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d5ae4-335f-4622-bc80-15e2dedb7ce2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:58.850271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 587/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:20:58 2022] GET /identity/v3/role_assignments?user.id=96c91ce5e28548e58a39bae1edcd5067&scope.project.id=9f7047b24ead4adf843895460a640e4c&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:00.860852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa760d-94b0-401e-ae3e-4fbb593a1285 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:00.861416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa760d-94b0-401e-ae3e-4fbb593a1285 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:00.861416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa760d-94b0-401e-ae3e-4fbb593a1285 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:00.863540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 575/1162] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:00.871988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35492b-b096-485d-8f11-4e296360dcc3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:00.872385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35492b-b096-485d-8f11-4e296360dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:00.872581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35492b-b096-485d-8f11-4e296360dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:00.900282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fd35492b-b096-485d-8f11-4e296360dcc3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:00.901418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fd35492b-b096-485d-8f11-4e296360dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:00.972924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 588/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:21:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:21:00.996854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa760d-94b0-401e-ae3e-4fbb593a1285 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:01.034275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:01.119575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa760d-94b0-401e-ae3e-4fbb593a1285 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:01.155113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:01.155653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:01.155932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:01.156189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:01.231320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:01.232762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:01.268484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:01.339188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 576/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:21:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:21:01.348265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35492b-b096-485d-8f11-4e296360dcc3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:01.436720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:01.454307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35492b-b096-485d-8f11-4e296360dcc3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:01.496825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85fed8-6597-43dd-82e7-cbb08f8fd76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:01.497473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fed8-6597-43dd-82e7-cbb08f8fd76a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:01.497753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fed8-6597-43dd-82e7-cbb08f8fd76a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:01.498019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fed8-6597-43dd-82e7-cbb08f8fd76a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:01.505215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85fed8-6597-43dd-82e7-cbb08f8fd76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:01.506685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85fed8-6597-43dd-82e7-cbb08f8fd76a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3c85fed8-6597-43dd-82e7-cbb08f8fd76a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:21:01.518447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:21:01.519609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:21:01.520509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 589/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:21:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:21:01.526053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:01.629632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e07ed-1123-409a-bad9-50b4100ad1b3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:01.659260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:01.665202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbe79e-66dc-4280-be51-9df5a1feead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:01.665839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe79e-66dc-4280-be51-9df5a1feead1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:01.666114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe79e-66dc-4280-be51-9df5a1feead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:01.666386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe79e-66dc-4280-be51-9df5a1feead1 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:01.667005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbe79e-66dc-4280-be51-9df5a1feead1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:01.667308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbe79e-66dc-4280-be51-9df5a1feead1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:01.668672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbe79e-66dc-4280-be51-9df5a1feead1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:01.676433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 577/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Aug 8 02:21:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:03.655756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629356-742c-402d-9e57-7bc5b81170df None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:03.656266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629356-742c-402d-9e57-7bc5b81170df None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:03.656266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629356-742c-402d-9e57-7bc5b81170df None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:03.657661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 590/1167] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:03.665475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d977-d1c9-4a44-85c9-27de85960372 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:03.665885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d977-d1c9-4a44-85c9-27de85960372 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:03.666017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d977-d1c9-4a44-85c9-27de85960372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:03.685973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9f07d977-d1c9-4a44-85c9-27de85960372 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:03.687151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9f07d977-d1c9-4a44-85c9-27de85960372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:03.756404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 578/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:21:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:21:03.780224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18629356-742c-402d-9e57-7bc5b81170df None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:03.888427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18629356-742c-402d-9e57-7bc5b81170df None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:03.922707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f9607-637c-4446-8010-2142f7d07382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:03.923305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9607-637c-4446-8010-2142f7d07382 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:03.923560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9607-637c-4446-8010-2142f7d07382 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:03.923834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9607-637c-4446-8010-2142f7d07382 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:03.924476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f9607-637c-4446-8010-2142f7d07382 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:03.925871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f9607-637c-4446-8010-2142f7d07382 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:03.945456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 591/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Mon Aug 8 02:21:03 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:05.929254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e0d60-32f3-4464-babe-de5808fdc7d9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:05.930588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e0d60-32f3-4464-babe-de5808fdc7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:05.930588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e0d60-32f3-4464-babe-de5808fdc7d9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:05.931306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 579/1170] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:05.936725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743bf73-8072-4408-a31c-08b84227ab6c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:05.937179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743bf73-8072-4408-a31c-08b84227ab6c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:05.937280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743bf73-8072-4408-a31c-08b84227ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:05.944694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:05.956962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6743bf73-8072-4408-a31c-08b84227ab6c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:05.958376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6743bf73-8072-4408-a31c-08b84227ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:06.025822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 592/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:21:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:21:06.048286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e0d60-32f3-4464-babe-de5808fdc7d9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:06.151673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e0d60-32f3-4464-babe-de5808fdc7d9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:06.181465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:06.192656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd251fec-1e2e-43fc-a63f-96473c254263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:06.193279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd251fec-1e2e-43fc-a63f-96473c254263 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:06.193586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd251fec-1e2e-43fc-a63f-96473c254263 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:06.193858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd251fec-1e2e-43fc-a63f-96473c254263 None admin] PATH_INFO: `/v3/domains/a3334e3104ad413b9f50b94e3d837b0d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:06.205108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd251fec-1e2e-43fc-a63f-96473c254263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3334e3104ad413b9f50b94e3d837b0d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:06.206600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd251fec-1e2e-43fc-a63f-96473c254263 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:06.208185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 580/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Mon Aug 8 02:21:06 2022] GET /identity/v3/domains/a3334e3104ad413b9f50b94e3d837b0d => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:06.214311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743bf73-8072-4408-a31c-08b84227ab6c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:06.324297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743bf73-8072-4408-a31c-08b84227ab6c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:06.360133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9c161-360e-4a29-871b-33edf8afb59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:06.360745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9c161-360e-4a29-871b-33edf8afb59d None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:06.361019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9c161-360e-4a29-871b-33edf8afb59d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:06.361286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9c161-360e-4a29-871b-33edf8afb59d None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:06.361964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9c161-360e-4a29-871b-33edf8afb59d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:06.363385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9c161-360e-4a29-871b-33edf8afb59d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:06.368396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:06.393645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 593/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:21:06 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:08.396399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b71e8-b3a3-47f9-8823-c7e8af9b0b94 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:08.396965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b71e8-b3a3-47f9-8823-c7e8af9b0b94 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:08.396965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b71e8-b3a3-47f9-8823-c7e8af9b0b94 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:08.398401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 581/1174] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:08.404636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9276a-a266-4f0b-afe8-a6ed62b999b0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:08.405344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9276a-a266-4f0b-afe8-a6ed62b999b0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:08.405491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9276a-a266-4f0b-afe8-a6ed62b999b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:08.431410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8bd9276a-a266-4f0b-afe8-a6ed62b999b0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:08.432598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8bd9276a-a266-4f0b-afe8-a6ed62b999b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:08.507111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 594/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:21:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:21:08.531538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b71e8-b3a3-47f9-8823-c7e8af9b0b94 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:08.640507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b71e8-b3a3-47f9-8823-c7e8af9b0b94 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:08.675238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e98758-1bcc-46b3-afe4-9b7dca51b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:08.675789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98758-1bcc-46b3-afe4-9b7dca51b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:08.676063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98758-1bcc-46b3-afe4-9b7dca51b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:08.676325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98758-1bcc-46b3-afe4-9b7dca51b4f8 None admin] PATH_INFO: `/v3/domains/a3334e3104ad413b9f50b94e3d837b0d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:08.677571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e98758-1bcc-46b3-afe4-9b7dca51b4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3334e3104ad413b9f50b94e3d837b0d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:08.679001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e98758-1bcc-46b3-afe4-9b7dca51b4f8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:08.680609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 582/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Mon Aug 8 02:21:08 2022] GET /identity/v3/domains/a3334e3104ad413b9f50b94e3d837b0d => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:08.689715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9276a-a266-4f0b-afe8-a6ed62b999b0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:08.795597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9276a-a266-4f0b-afe8-a6ed62b999b0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:08.812823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:08.836250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b8c27-85bd-4fc5-945d-c7a06e61d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:08.836954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8c27-85bd-4fc5-945d-c7a06e61d3e1 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:08.837229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8c27-85bd-4fc5-945d-c7a06e61d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:08.837545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8c27-85bd-4fc5-945d-c7a06e61d3e1 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:08.838178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b8c27-85bd-4fc5-945d-c7a06e61d3e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:08.839606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b8c27-85bd-4fc5-945d-c7a06e61d3e1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:08.862721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 595/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:21:08 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:10.884277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eaa27-4d95-4eaf-9b79-6ed775659b50 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:10.884783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eaa27-4d95-4eaf-9b79-6ed775659b50 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:10.884892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eaa27-4d95-4eaf-9b79-6ed775659b50 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:10.886967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 583/1178] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:21:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:10.895716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d88362-1ce3-4b55-a1d9-74e824ab3395 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:10.896114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d88362-1ce3-4b55-a1d9-74e824ab3395 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:10.896330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d88362-1ce3-4b55-a1d9-74e824ab3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:10.921872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-42d88362-1ce3-4b55-a1d9-74e824ab3395 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:10.923069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42d88362-1ce3-4b55-a1d9-74e824ab3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:11.007019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 596/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:21:11.030508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eaa27-4d95-4eaf-9b79-6ed775659b50 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:11.095824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:11.145109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eaa27-4d95-4eaf-9b79-6ed775659b50 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:11.189193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:11.190169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:11.190599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:11.191019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:11.209833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:21:11.214987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:21:11.216035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:21:11.216980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 584/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:21:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:21:11.222502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d88362-1ce3-4b55-a1d9-74e824ab3395 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:11.347561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d88362-1ce3-4b55-a1d9-74e824ab3395 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:11.349128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:11.384419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:11.385024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:11.385302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:11.385619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:11.386257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:11.386559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:11.387936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:11.396001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 597/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:21:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:11.402377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:11.506963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415ea7c-e9a2-4b81-bf12-9968e3602546 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:11.520860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:11.542664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:11.543340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:11.543617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:11.543889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] PATH_INFO: `/v3/users/9276c29fcaf24af5a6a19c9288f5bfdc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:11.557957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] RBAC: Authorizing `identity:get_user(user_id=9276c29fcaf24af5a6a19c9288f5bfdc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:11.559422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:11.561090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 585/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:21:11 2022] GET /identity/v3/users/9276c29fcaf24af5a6a19c9288f5bfdc => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:11.567278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:11.673069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a8dce-2ff6-4852-9920-721efb6676b0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:11.708216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:11.708816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:11.709087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:11.709354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:11.742537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:11.787258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:11.788864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:11.888200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 598/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:21:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:21:11.895227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:11.999341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee069-808f-4038-8255-d8edbb44a023 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:12.035958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b0aa8-ecdb-49f0-9ac1-1d1e197edb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:12.036577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b0aa8-ecdb-49f0-9ac1-1d1e197edb40 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:12.036856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b0aa8-ecdb-49f0-9ac1-1d1e197edb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:12.037131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b0aa8-ecdb-49f0-9ac1-1d1e197edb40 None admin] PATH_INFO: `/v3/projects/1d99dd0809c1417e9fc03efede191a3b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:12.038318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b0aa8-ecdb-49f0-9ac1-1d1e197edb40 None admin] RBAC: Authorizing `identity:get_project(project_id=1d99dd0809c1417e9fc03efede191a3b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:12.039791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b0aa8-ecdb-49f0-9ac1-1d1e197edb40 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:12.041456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 586/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:21:11 2022] GET /identity/v3/projects/1d99dd0809c1417e9fc03efede191a3b => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:12.047659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:12.118160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:12.159358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3984be7-e2e1-4701-a7dd-c5bb9966a496 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:12.194729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98022a68-9373-472e-9bd3-6d873d95f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:12.195532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022a68-9373-472e-9bd3-6d873d95f668 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:12.195813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022a68-9373-472e-9bd3-6d873d95f668 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:12.196083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022a68-9373-472e-9bd3-6d873d95f668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:12.196800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022a68-9373-472e-9bd3-6d873d95f668 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=1d99dd0809c1417e9fc03efede191a3b, user.id=9276c29fcaf24af5a6a19c9288f5bfdc) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:12.197109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022a68-9373-472e-9bd3-6d873d95f668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:12.198917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022a68-9373-472e-9bd3-6d873d95f668 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:12.204977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 599/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:21:12 2022] GET /identity/v3/role_assignments?user.id=9276c29fcaf24af5a6a19c9288f5bfdc&scope.project.id=1d99dd0809c1417e9fc03efede191a3b&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:14.158268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529043-dd1a-4d9e-8a2a-3069532b5b4e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:14.158866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529043-dd1a-4d9e-8a2a-3069532b5b4e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:14.158866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529043-dd1a-4d9e-8a2a-3069532b5b4e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:14.160138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 587/1186] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:14.166549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab647-ccba-49c3-94b3-5a22f13a9f4f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:14.167226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab647-ccba-49c3-94b3-5a22f13a9f4f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:14.167398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab647-ccba-49c3-94b3-5a22f13a9f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:14.190916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-028ab647-ccba-49c3-94b3-5a22f13a9f4f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:14.192744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-028ab647-ccba-49c3-94b3-5a22f13a9f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:14.262070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 600/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:21:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:21:14.288788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529043-dd1a-4d9e-8a2a-3069532b5b4e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:14.336420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:14.409302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529043-dd1a-4d9e-8a2a-3069532b5b4e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:14.447559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:14.448526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:14.448801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:14.449072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:14.461142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:21:14.465833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:21:14.466876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:21:14.468017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 588/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:21:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:21:14.473212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ab647-ccba-49c3-94b3-5a22f13a9f4f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:14.532123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:14.575497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ab647-ccba-49c3-94b3-5a22f13a9f4f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:14.611132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:14.611725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:14.612001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:14.612272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:14.612898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:14.613225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:14.614629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:14.623633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 601/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:21:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:14.631733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:14.738615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:14.742346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc20ff1-f84b-4083-9cef-8a4318888881 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:14.776866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:14.777521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:14.777812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:14.778079 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] PATH_INFO: `/v3/users/9276c29fcaf24af5a6a19c9288f5bfdc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:14.779231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] RBAC: Authorizing `identity:get_user(user_id=9276c29fcaf24af5a6a19c9288f5bfdc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:14.780664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:14.782273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 589/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:21:14 2022] GET /identity/v3/users/9276c29fcaf24af5a6a19c9288f5bfdc => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:14.791663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:14.906734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69c3e-0867-4186-8e48-6834518c46e3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:14.926413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:14.949897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37642cbb-1639-4725-865d-7219c554dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:14.950538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642cbb-1639-4725-865d-7219c554dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:14.950823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642cbb-1639-4725-865d-7219c554dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:14.951092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642cbb-1639-4725-865d-7219c554dac3 None admin] PATH_INFO: `/v3/projects/1d99dd0809c1417e9fc03efede191a3b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:14.952421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37642cbb-1639-4725-865d-7219c554dac3 None admin] RBAC: Authorizing `identity:get_project(project_id=1d99dd0809c1417e9fc03efede191a3b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:14.953924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37642cbb-1639-4725-865d-7219c554dac3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:14.955590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 602/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:21:14 2022] GET /identity/v3/projects/1d99dd0809c1417e9fc03efede191a3b => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:14.963802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:15.070768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0c55-77ec-4eec-a9a6-d0cfb750339a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:15.106387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd639a1-c09d-46bc-9689-4943d42f7bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:15.107040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd639a1-c09d-46bc-9689-4943d42f7bcc None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:15.107324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd639a1-c09d-46bc-9689-4943d42f7bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:15.107599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd639a1-c09d-46bc-9689-4943d42f7bcc None admin] PATH_INFO: `/v3/projects/1d99dd0809c1417e9fc03efede191a3b/users/9276c29fcaf24af5a6a19c9288f5bfdc/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:15.109797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd639a1-c09d-46bc-9689-4943d42f7bcc None admin] RBAC: Authorizing `identity:create_grant(project_id=1d99dd0809c1417e9fc03efede191a3b, user_id=9276c29fcaf24af5a6a19c9288f5bfdc, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:15.111259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd639a1-c09d-46bc-9689-4943d42f7bcc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:15.127321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 590/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:21:14 2022] PUT /identity/v3/projects/1d99dd0809c1417e9fc03efede191a3b/users/9276c29fcaf24af5a6a19c9288f5bfdc/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:21:17.093361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7dd6f-558e-4ff7-b76d-1942c328ef62 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:17.094343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7dd6f-558e-4ff7-b76d-1942c328ef62 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:17.094343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7dd6f-558e-4ff7-b76d-1942c328ef62 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:17.096668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 603/1193] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:21:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:17.101881 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c46c2-eb4d-4078-b4a3-c2e3ea6f6073 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:17.102318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c46c2-eb4d-4078-b4a3-c2e3ea6f6073 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:17.102413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c46c2-eb4d-4078-b4a3-c2e3ea6f6073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:17.122088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8c7c46c2-eb4d-4078-b4a3-c2e3ea6f6073 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:17.123272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8c7c46c2-eb4d-4078-b4a3-c2e3ea6f6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:17.146310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:17.204238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 591/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:21:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:21:17.227960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7dd6f-558e-4ff7-b76d-1942c328ef62 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:17.341326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7dd6f-558e-4ff7-b76d-1942c328ef62 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:17.376171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:17.376731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:17.377008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:17.377276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:17.388732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:21:17.393416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:21:17.394531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:21:17.395605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:21:17.397547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 604/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:21:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:21:17.400846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c46c2-eb4d-4078-b4a3-c2e3ea6f6073 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:17.512138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c46c2-eb4d-4078-b4a3-c2e3ea6f6073 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:17.548793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:17.549482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:17.549651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:17.549953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:17.550618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:17.550920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:17.552303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:17.561043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 592/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:21:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:17.570400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:17.634194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:17.688901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4fd58-50aa-4761-b60f-f5c1200920c9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:17.724566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:17.725188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:17.725494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:17.725765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] PATH_INFO: `/v3/users/9276c29fcaf24af5a6a19c9288f5bfdc` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:17.727119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] RBAC: Authorizing `identity:get_user(user_id=9276c29fcaf24af5a6a19c9288f5bfdc)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:17.728559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:17.730179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 605/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Aug 8 02:21:17 2022] GET /identity/v3/users/9276c29fcaf24af5a6a19c9288f5bfdc => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:17.736451 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:17.762645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:17.847842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83e10-1e9e-4c55-b6ba-62e6306990a1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:17.883829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:17.884486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:17.884700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:17.884962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:17.953392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:17.954868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:17.975241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:18.056308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 593/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:21:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:21:18.063345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:18.178811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb25d4-c93a-4364-afdb-ec02ed9a5bcd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:18.196117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:18.218665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea02b0-81c9-4e0d-a820-f92afc0801e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:18.219303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea02b0-81c9-4e0d-a820-f92afc0801e6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:18.219577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea02b0-81c9-4e0d-a820-f92afc0801e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:18.219847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea02b0-81c9-4e0d-a820-f92afc0801e6 None admin] PATH_INFO: `/v3/projects/1d99dd0809c1417e9fc03efede191a3b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:18.221065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea02b0-81c9-4e0d-a820-f92afc0801e6 None admin] RBAC: Authorizing `identity:get_project(project_id=1d99dd0809c1417e9fc03efede191a3b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:18.222527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea02b0-81c9-4e0d-a820-f92afc0801e6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:18.224196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 606/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Aug 8 02:21:18 2022] GET /identity/v3/projects/1d99dd0809c1417e9fc03efede191a3b => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:18.230774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:18.355857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609829b9-c263-4300-b7d0-04bed0487176 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:18.376987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:18.393105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b1db5-f5cd-407d-b428-c34f053665e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:18.393742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1db5-f5cd-407d-b428-c34f053665e5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:18.394018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1db5-f5cd-407d-b428-c34f053665e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:18.394287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1db5-f5cd-407d-b428-c34f053665e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:18.395005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b1db5-f5cd-407d-b428-c34f053665e5 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=1d99dd0809c1417e9fc03efede191a3b, user.id=9276c29fcaf24af5a6a19c9288f5bfdc) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:18.395309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b1db5-f5cd-407d-b428-c34f053665e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:18.396784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b1db5-f5cd-407d-b428-c34f053665e5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:18.403436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 594/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:21:18 2022] GET /identity/v3/role_assignments?user.id=9276c29fcaf24af5a6a19c9288f5bfdc&scope.project.id=1d99dd0809c1417e9fc03efede191a3b&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:28.212838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=8 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:28.400583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=8 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:13.973249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9185-41a3-4157-9548-8eb23c6e4de2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.973866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9185-41a3-4157-9548-8eb23c6e4de2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.973866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9185-41a3-4157-9548-8eb23c6e4de2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:13.975600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 607/1201] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:13.982317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad8ca0-6622-4819-86c7-c389b2e18058 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:13.982900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad8ca0-6622-4819-86c7-c389b2e18058 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:13.982900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad8ca0-6622-4819-86c7-c389b2e18058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.007067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-60ad8ca0-6622-4819-86c7-c389b2e18058 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:14.008272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60ad8ca0-6622-4819-86c7-c389b2e18058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:14.132994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 595/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:22:14.155271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9185-41a3-4157-9548-8eb23c6e4de2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.282098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9185-41a3-4157-9548-8eb23c6e4de2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.325561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.326252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.326570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.326850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.338910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.340532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:14.369208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:14.370736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:14.371688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:14.371688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:14.371688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:14.371688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 608/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:14.377041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad8ca0-6622-4819-86c7-c389b2e18058 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.504984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad8ca0-6622-4819-86c7-c389b2e18058 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.544577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:14.552568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424b628-18f0-4d27-9fa3-0aca95d65d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.553315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b628-18f0-4d27-9fa3-0aca95d65d6d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.554382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b628-18f0-4d27-9fa3-0aca95d65d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.554672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424b628-18f0-4d27-9fa3-0aca95d65d6d None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.555330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424b628-18f0-4d27-9fa3-0aca95d65d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:14.555632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424b628-18f0-4d27-9fa3-0aca95d65d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.557021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424b628-18f0-4d27-9fa3-0aca95d65d6d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.578356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 596/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:14.579640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:14.651005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:14.714250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aeb74-0fa7-4260-9399-3785f11fad02 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:14.753940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b396c-6673-4571-9dc4-dc4281abf8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:14.754611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b396c-6673-4571-9dc4-dc4281abf8be None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:14.754870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b396c-6673-4571-9dc4-dc4281abf8be None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:14.755152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b396c-6673-4571-9dc4-dc4281abf8be None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:14.755862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b396c-6673-4571-9dc4-dc4281abf8be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:14.757523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b396c-6673-4571-9dc4-dc4281abf8be None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:14.797471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 609/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Aug 8 02:22:14 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:17.090528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c643d5a-17b9-432b-b815-96198bd11081 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.091167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c643d5a-17b9-432b-b815-96198bd11081 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.091167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c643d5a-17b9-432b-b815-96198bd11081 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.092552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 597/1206] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:17.098295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba552cc-6b95-468f-810f-ee0d384297ec None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.098842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba552cc-6b95-468f-810f-ee0d384297ec None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.098842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba552cc-6b95-468f-810f-ee0d384297ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.119974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fba552cc-6b95-468f-810f-ee0d384297ec None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:17.121408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fba552cc-6b95-468f-810f-ee0d384297ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:17.202652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 610/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:22:17.228653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c643d5a-17b9-432b-b815-96198bd11081 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.364835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c643d5a-17b9-432b-b815-96198bd11081 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.404098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.404098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.404098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.404468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.415345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:22:17.420566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:17.421740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:17.427810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 598/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:17.429952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba552cc-6b95-468f-810f-ee0d384297ec None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.476933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:17.561324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba552cc-6b95-468f-810f-ee0d384297ec None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.600071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.601283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.601878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.602451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.603785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:17.604387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:17.606680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:17.616097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 611/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:17.622166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.680504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:17.735975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48078-419e-4ade-8140-b4b5b46a851d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.777848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.778083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.778310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.778479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.789994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:17.791538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:17.810823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:17.811909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:17.812795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:17.812795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:17.812795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:17.812795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 599/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:17.817966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:17.927822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:17.935065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef35d-90d9-4c40-b1a4-d104c2e7042b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:17.974958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:17.975712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:17.976099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:17.976425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:17.977214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:17.977637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:17.979199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:17.997156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 612/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:17.998835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.120344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236695c-6153-4c53-9138-b17c4fdaf9e7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.122025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:18.157978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.160977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.161265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.161552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.169192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.170694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:22:18.182733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:18.183912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:18.184845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 600/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:22:18.189872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.307157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba115-4452-45cb-9c9c-1f054985e809 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.349434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.350240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.350518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.350779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.351566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:18.351866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.353318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.374940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 613/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Aug 8 02:22:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:18.380285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.493424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf9248-6ce5-4fe0-b404-76d26b378a11 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.534572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.535342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.535780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.536156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.570549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:18.619438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.621358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.742582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 601/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:22:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:22:18.749578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:18.769466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:18.859760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aaf4b-be06-4a0f-af5d-579261ab6505 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:18.898591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:18.899272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:18.899553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:18.899818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:18.911501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:18.913171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:18.928790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:18.929848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:18.930721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:18.930721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:18.930721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:18.930721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 614/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:18.936081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.000662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:19.042333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbac7e-9acc-479d-9c4e-8dc8467df898 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.080383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.081140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.081576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.082037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.082704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:19.082986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.084391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:19.096502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 602/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:19.103399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.181565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:19.220085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56eb5-637c-4db6-9e1a-8502f7b7c3e6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.260497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.260497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.260497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.260852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.267869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.269314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:22:19.283448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:19.284691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:19.286057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:19.289714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 615/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:22:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:19.291493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.401519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05fe3-fef9-4a0c-b9c2-3898e481027a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.430064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:19.445092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12222a81-9b45-4c8b-a1ef-3ea8994ead5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.445761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222a81-9b45-4c8b-a1ef-3ea8994ead5c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.446040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222a81-9b45-4c8b-a1ef-3ea8994ead5c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.446311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222a81-9b45-4c8b-a1ef-3ea8994ead5c None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.447347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12222a81-9b45-4c8b-a1ef-3ea8994ead5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:19.447680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12222a81-9b45-4c8b-a1ef-3ea8994ead5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.449126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12222a81-9b45-4c8b-a1ef-3ea8994ead5c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:19.463448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 603/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:22:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:19.469999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:19.575881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ecf6c-2b9b-4343-8818-515fc2d88a05 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:19.605542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:19.613240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bd8bd-c11a-4ce1-b099-83c277edb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:19.613869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bd8bd-c11a-4ce1-b099-83c277edb05d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:19.614288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bd8bd-c11a-4ce1-b099-83c277edb05d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:19.614611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bd8bd-c11a-4ce1-b099-83c277edb05d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:19.615808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bd8bd-c11a-4ce1-b099-83c277edb05d None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=624d4aaae75d49a59610ebc30d150f50) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:19.616463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bd8bd-c11a-4ce1-b099-83c277edb05d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:19.619215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bd8bd-c11a-4ce1-b099-83c277edb05d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:19.626950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 616/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:22:19 2022] GET /identity/v3/role_assignments?user.id=624d4aaae75d49a59610ebc30d150f50&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:21.581115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d877-b006-4198-a9b6-f8900bc771ab None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.581775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d877-b006-4198-a9b6-f8900bc771ab None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.581775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d877-b006-4198-a9b6-f8900bc771ab None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.583074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 604/1220] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:21.588472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbf4c-9732-4076-bb84-2bf37bf2826d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.588930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbf4c-9732-4076-bb84-2bf37bf2826d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.589017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbf4c-9732-4076-bb84-2bf37bf2826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.608300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f46cbf4c-9732-4076-bb84-2bf37bf2826d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:21.609543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f46cbf4c-9732-4076-bb84-2bf37bf2826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:21.688605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 617/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:22:21.714038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d877-b006-4198-a9b6-f8900bc771ab None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:21.824126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d877-b006-4198-a9b6-f8900bc771ab None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:21.862488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:21.863279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:21.863734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:21.864040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:21.875171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:22:21.879813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:21.881018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:21.882282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 605/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:22:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:21.887755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cbf4c-9732-4076-bb84-2bf37bf2826d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.000043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cbf4c-9732-4076-bb84-2bf37bf2826d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.026171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:22.038572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.039572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.040087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.040562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.041633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:22.041926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.043668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.053011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 618/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:22.059268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.111208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:22.177420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214f29-3d95-4c39-a4bc-301fbf606706 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.216859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.217561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.217876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.218187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.229394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.230870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:22.248695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:22.249837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:22.250750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:22.250750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:22.250750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:22.250750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 606/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:22.256104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.367177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da444-275d-45ea-a7fc-3c4846a5edf6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.400861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.401485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.401764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.402035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.402676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:22.402987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.404341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.416504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 619/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:22.422567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.532330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:22.540456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f05e1-13ff-4e26-b9c9-3de3a7668431 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.573993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.574716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.574994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.575299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.582968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.584479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:22:22.596501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:22.597616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:22.598547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 607/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:22.605714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.655948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:22.708554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d773-078d-4b2e-92ee-49349d284c34 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.745895 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.746563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.746851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.747118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.747851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:22.748156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.749616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.767898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 620/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:22.774020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:22.879651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1a757-a4cf-45c1-817e-9201e0f20821 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:22.916993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:22.917720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:22.918090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:22.918340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:22.929608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:22.931056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:22.945901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:22.947477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:22.948406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:22.948406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:22.948406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:22.948406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 608/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:22.953541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:23.059305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e917a5-a984-44cc-8740-11706a5ce0f9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:23.061816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:23.096929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:23.097539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:23.097817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:23.098139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:23.098723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:23.099021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:23.100478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:23.111943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 621/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:23.118124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:23.127653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:23.226119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186926-6938-4dcc-adef-287a546ede8f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:23.263250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:23.263897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:23.264169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:23.264440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:23.271022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:23.272549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:22:23.283690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:23.284740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:23.285658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 609/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:22:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:23.290976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:23.393623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6676-716c-48ad-8f5f-f360f8fa9fde None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:23.427031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805e949-70ac-4c0b-bcbb-e86e33650f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:23.427640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e949-70ac-4c0b-bcbb-e86e33650f74 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:23.427932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e949-70ac-4c0b-bcbb-e86e33650f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:23.428323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e949-70ac-4c0b-bcbb-e86e33650f74 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:23.429167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805e949-70ac-4c0b-bcbb-e86e33650f74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:23.429499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805e949-70ac-4c0b-bcbb-e86e33650f74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:23.430993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805e949-70ac-4c0b-bcbb-e86e33650f74 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:23.444318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 622/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:23.451440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:23.522853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:23.561706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206512-d4cd-4fb3-9c94-668fc3c5f267 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:23.597263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8a629-5600-4ac3-ad97-76f9381293ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:23.598039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a629-5600-4ac3-ad97-76f9381293ac None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:23.598248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a629-5600-4ac3-ad97-76f9381293ac None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:23.598512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a629-5600-4ac3-ad97-76f9381293ac None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/624d4aaae75d49a59610ebc30d150f50/roles/d8d8369da6884d00a8c296ddc1619fb6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:23.613518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8a629-5600-4ac3-ad97-76f9381293ac None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=624d4aaae75d49a59610ebc30d150f50, role_id=d8d8369da6884d00a8c296ddc1619fb6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:23.614953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8a629-5600-4ac3-ad97-76f9381293ac None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:23.628525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 610/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:22:23 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/624d4aaae75d49a59610ebc30d150f50/roles/d8d8369da6884d00a8c296ddc1619fb6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:22:25.714514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9118d0c-8f0a-4d1b-88b8-ab33855cde42 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.715100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9118d0c-8f0a-4d1b-88b8-ab33855cde42 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.715100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9118d0c-8f0a-4d1b-88b8-ab33855cde42 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.716410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 623/1233] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:25.721740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78c93f-d933-4496-bbca-e6aad3742045 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:25.722170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78c93f-d933-4496-bbca-e6aad3742045 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:25.722278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78c93f-d933-4496-bbca-e6aad3742045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:25.743977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7b78c93f-d933-4496-bbca-e6aad3742045 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:25.743977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7b78c93f-d933-4496-bbca-e6aad3742045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:25.834026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 611/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:25.860991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9118d0c-8f0a-4d1b-88b8-ab33855cde42 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:25.886907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:25.964618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9118d0c-8f0a-4d1b-88b8-ab33855cde42 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.000236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.000841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.001116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.001414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.013240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:22:26.017933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:26.020559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:26.021917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 624/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Aug 8 02:22:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:26.025722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78c93f-d933-4496-bbca-e6aad3742045 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.076000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:26.147653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78c93f-d933-4496-bbca-e6aad3742045 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.187386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.188009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.188293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.188611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.189241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:26.189579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.191129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.201420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 612/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:26.207814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.323623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:26.355376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fd6f-77e9-46ef-8b0b-b8b8154182cd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.398516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.399064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.400490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.400490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.412441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.413915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:26.431230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:26.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:26.433853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:26.433853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:26.433853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:26.433853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 625/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:26.438595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.566496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d8c30-1540-4f57-85aa-086461bffcc8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.579327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:26.621572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.622298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.622599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.622909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.623637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:26.623996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.625856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.640422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 613/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:26.647047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.784144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733395-7d88-4d69-aab4-56b9d2f6090c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:26.825865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:26.826845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:26.827364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:26.827851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:26.832205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:26.839109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:26.840943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:22:26.865035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:26.866945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:26.867995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 626/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:26.873547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:26.982583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca07ad-3cbb-42c3-8c93-4ff14a7e5c19 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.023178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.023848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.024126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.024396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.025134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:27.025470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.032226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.059180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 614/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Aug 8 02:22:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:27.069913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.174314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c31aa-52ad-415c-a024-78d6d8d521e7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.211516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.212172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.212495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.212808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.276352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:27.285956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.287593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.414430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 627/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:22:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:22:27.420456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.449479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:27.522585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9482c-06d9-40a5-8928-7d8aaec95fc5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.558475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.559098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.559372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.559636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.570214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.572208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:27.588212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:27.589511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:27.590416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:27.590416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:27.590416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:27.590416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 615/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:27.595346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.698751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:27.704926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de82c0-9fb7-4fba-9665-86ce06c7ef92 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.739471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.740108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.740493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.740892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.741576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:27.741881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.743265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.755412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 628/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:27.761673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:27.842866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:27.866707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea05f7-2292-4ab0-a9d0-ffa640d7b371 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:27.902481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:27.903370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:27.903743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:27.904146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:27.912427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:27.914094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:22:27.925831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:27.926953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:27.928109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 616/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:22:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:27.932948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:28.039233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4e70-684b-46d5-9268-da7fc37d103b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:28.074531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77817-e2be-4a1f-9e58-1d5b13d4f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:28.075145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77817-e2be-4a1f-9e58-1d5b13d4f00a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:28.075420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77817-e2be-4a1f-9e58-1d5b13d4f00a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:28.075687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77817-e2be-4a1f-9e58-1d5b13d4f00a None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:28.076372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77817-e2be-4a1f-9e58-1d5b13d4f00a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:28.076672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77817-e2be-4a1f-9e58-1d5b13d4f00a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:28.078123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77817-e2be-4a1f-9e58-1d5b13d4f00a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:28.091350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 629/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:22:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:28.097471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:28.215804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a17ff-cfbb-4e54-80cc-306923c89beb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:28.256478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31407941-3a50-4ce9-9f7b-a1d1a11e6458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:28.257096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31407941-3a50-4ce9-9f7b-a1d1a11e6458 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:28.257402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31407941-3a50-4ce9-9f7b-a1d1a11e6458 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:28.257661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31407941-3a50-4ce9-9f7b-a1d1a11e6458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:28.258390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31407941-3a50-4ce9-9f7b-a1d1a11e6458 None admin] RBAC: Adding query filter params (role.id=d8d8369da6884d00a8c296ddc1619fb6, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=624d4aaae75d49a59610ebc30d150f50) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:28.258694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31407941-3a50-4ce9-9f7b-a1d1a11e6458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:28.260139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31407941-3a50-4ce9-9f7b-a1d1a11e6458 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:28.266229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 617/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:22:28 2022] GET /identity/v3/role_assignments?user.id=624d4aaae75d49a59610ebc30d150f50&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=d8d8369da6884d00a8c296ddc1619fb6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:30.465960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44936-eddc-47d1-a6d2-cc690fbf193d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:30.466533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44936-eddc-47d1-a6d2-cc690fbf193d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:30.466533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44936-eddc-47d1-a6d2-cc690fbf193d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:30.467866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 630/1247] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:30.474272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb39bc-3f00-434c-ab2d-12c4738026ec None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:30.474808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb39bc-3f00-434c-ab2d-12c4738026ec None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:30.475048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb39bc-3f00-434c-ab2d-12c4738026ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:30.482181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:30.496012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3ebb39bc-3f00-434c-ab2d-12c4738026ec None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:30.497220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3ebb39bc-3f00-434c-ab2d-12c4738026ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:30.571127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 618/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:30.595147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a44936-eddc-47d1-a6d2-cc690fbf193d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:30.616179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:30.714788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a44936-eddc-47d1-a6d2-cc690fbf193d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:30.750521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:30.751092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:30.751372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:30.751683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:30.763301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:22:30.768044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:30.769006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:30.770357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 631/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:22:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:30.776009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb39bc-3f00-434c-ab2d-12c4738026ec None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:30.890638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb39bc-3f00-434c-ab2d-12c4738026ec None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:30.921501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:30.927252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:30.927909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:30.928195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:30.928469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:30.929146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:30.929498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:30.930882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:30.939529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 619/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:22:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:30.945565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:31.029139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:31.054304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750319d-e7e0-4818-83e4-13a8a6f3d6ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:31.091251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:31.091942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:31.092223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:31.092495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:31.103438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:31.104987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:31.119980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:31.121263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:31.122463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:31.122463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:31.122463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:31.122463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 632/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:31.127271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:31.238285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634a16e-6d56-42fa-962d-08b7825347ac None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:31.278027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:31.278697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:31.279043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:31.279383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:31.280078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:31.280422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:31.282026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:31.295576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 620/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:31.301873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:31.414283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88925-5e60-4304-83a1-767fa8dae402 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:31.443549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:31.454551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:31.455220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:31.455500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:31.455769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:31.464498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:31.465962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:22:31.478021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:31.479191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:31.480412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 633/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:31.485387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:31.545606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:31.595592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633dc31-39d8-4d28-8871-9dd1a20b4633 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:31.633474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:31.634098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:31.634377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:31.634653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:31.635393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:31.635699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:31.637166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:31.655942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 621/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Aug 8 02:22:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:31.662164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:31.775239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9e600-db1c-4bed-886c-5902e02cdae8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:31.818076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:31.818822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:31.819288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:31.819603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:31.887248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:31.903261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:31.904779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:32.017273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 634/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:22:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:22:32.023552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:32.140733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a741638-fab6-492e-8320-e4e425c8d5b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:32.157212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:32.183578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:32.184516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:32.185082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:32.185490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:32.199726 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:32.201681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:32.218675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:32.221204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:32.222319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:32.222319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:32.222319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:32.222319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 622/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:32.225865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:32.333664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:32.346133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b4be4-c226-49c9-a870-d198e2813a97 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:32.381264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:32.381914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:32.382147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:32.382411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:32.383044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:32.383340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:32.384700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:32.397591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 635/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:22:32.403848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:32.511252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baadc88-1ced-403f-8fc6-de46b34d3667 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:32.548863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:32.549907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:32.550504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:32.550840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:32.558826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:32.560303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:22:32.574174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:32.575352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:32.576443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:32.581443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:32.582047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 623/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:22:32.690638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23681-a588-43b5-8a5b-bf96e099c05a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:32.727339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977a9b-56a4-438f-a34a-cf098dbf2bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:32.727971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977a9b-56a4-438f-a34a-cf098dbf2bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:32.728249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977a9b-56a4-438f-a34a-cf098dbf2bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:32.728519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977a9b-56a4-438f-a34a-cf098dbf2bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:32.729221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977a9b-56a4-438f-a34a-cf098dbf2bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:32.729558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977a9b-56a4-438f-a34a-cf098dbf2bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:32.730995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977a9b-56a4-438f-a34a-cf098dbf2bd5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:32.744189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 636/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:32.750447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:32.777905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:32.864535 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6bdac-45e3-406d-abae-0484a1642550 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:32.901624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0eb9a-22b4-4829-af6d-33173015c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:32.902377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0eb9a-22b4-4829-af6d-33173015c7eb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:32.902696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0eb9a-22b4-4829-af6d-33173015c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:32.902991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0eb9a-22b4-4829-af6d-33173015c7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:32.903962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0eb9a-22b4-4829-af6d-33173015c7eb None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=624d4aaae75d49a59610ebc30d150f50) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:32.904339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0eb9a-22b4-4829-af6d-33173015c7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:32.906278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0eb9a-22b4-4829-af6d-33173015c7eb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:32.916330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 624/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:22:32 2022] GET /identity/v3/role_assignments?user.id=624d4aaae75d49a59610ebc30d150f50&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=1470302d39e340299072b424021b764b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:35.084938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aebfa8-0fb0-46e4-bea9-9f00ff196baf None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:35.085655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aebfa8-0fb0-46e4-bea9-9f00ff196baf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:35.085655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aebfa8-0fb0-46e4-bea9-9f00ff196baf None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:35.086932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 637/1261] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:35.093017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e0b3-307b-46fc-aa8b-5c6188614919 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:35.093604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e0b3-307b-46fc-aa8b-5c6188614919 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:35.093604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e0b3-307b-46fc-aa8b-5c6188614919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:35.113538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e909e0b3-307b-46fc-aa8b-5c6188614919 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:35.114786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e909e0b3-307b-46fc-aa8b-5c6188614919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:35.197037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 625/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:35.220556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aebfa8-0fb0-46e4-bea9-9f00ff196baf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:35.233897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:35.347021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aebfa8-0fb0-46e4-bea9-9f00ff196baf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:35.384404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:35.385046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:35.385324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:35.385624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:35.396393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:22:35.401232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:35.402177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:35.403007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 638/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:35.408693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909e0b3-307b-46fc-aa8b-5c6188614919 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:35.428541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:35.510238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909e0b3-307b-46fc-aa8b-5c6188614919 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:35.544772 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:35.545433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:35.545716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:35.545985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:35.546661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:35.546980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:35.548339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:35.556676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 626/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:22:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:35.562726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:35.633822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:35.666532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d438-007b-4573-bcd3-f3a9e800b239 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:35.703351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:35.703975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:35.704254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:35.704522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:35.714969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:35.716412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:35.731201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:35.732210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:35.733219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:35.733219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:35.733219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:35.733219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 639/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:35.738392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:35.829623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:35.850642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275504-5b6f-4572-a553-59be7d34dc1f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:35.884465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:35.884998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:35.885275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:35.885588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:35.886237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:35.886539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:35.887918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:35.899774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 627/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:35.905930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.018047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d205c-3c2c-45bb-ac88-1525b31c89ca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.037793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:36.052907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.053608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.053867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.054132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.061522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.062957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:22:36.074371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:36.075432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:36.076758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 640/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:36.083152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.188712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788825a-c160-41e1-b610-f68dc4ec4abd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.224110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.224783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.225096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.225398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.226122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:36.226431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.227856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.236387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:36.246110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 628/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Aug 8 02:22:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:36.254494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.373099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41b557-1473-402b-8540-c03867c85e41 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.407269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.407888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.408164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.408432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.419104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.420546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:36.434650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:36.435679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:36.436585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:36.436585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:36.436585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:36.436585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 641/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:22:36.444200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.547201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bedac2-abe7-4fd7-b53b-d9ee2758ba3d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.584847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.585502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.585782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.586055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.586696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:36.587001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.588394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.600721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 629/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:36.609212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.643289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:36.715111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050941c8-6046-428f-890a-34f1f52597f0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.755885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.756592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.756866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.757134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.763731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.765160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:22:36.776407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:36.777499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:36.778532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 642/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:22:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:36.786569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:36.854275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:36.898617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8c1b-ad61-410c-884c-1bb12303dfa4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:36.943642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6901f-e573-414e-b359-686d2ce773f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:36.944230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6901f-e573-414e-b359-686d2ce773f6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:36.944507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6901f-e573-414e-b359-686d2ce773f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:36.944777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6901f-e573-414e-b359-686d2ce773f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:36.945514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6901f-e573-414e-b359-686d2ce773f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:36.945801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6901f-e573-414e-b359-686d2ce773f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:36.947598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6901f-e573-414e-b359-686d2ce773f6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:36.959134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 630/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:36.965746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:37.062645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:37.072942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322f4e2-544e-4689-ab6d-ca6865527450 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:37.107593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3f2a-343f-4b2d-afb0-762811de0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:37.108235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3f2a-343f-4b2d-afb0-762811de0d21 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:37.108508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3f2a-343f-4b2d-afb0-762811de0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:37.108771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3f2a-343f-4b2d-afb0-762811de0d21 None admin] PATH_INFO: `/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/624d4aaae75d49a59610ebc30d150f50/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:37.110904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc3f2a-343f-4b2d-afb0-762811de0d21 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed167140af4d4039b6aa4a7d0ef9cfd5, user_id=624d4aaae75d49a59610ebc30d150f50, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:37.112310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc3f2a-343f-4b2d-afb0-762811de0d21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:37.127412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 643/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Aug 8 02:22:36 2022] PUT /identity/v3/projects/ed167140af4d4039b6aa4a7d0ef9cfd5/users/624d4aaae75d49a59610ebc30d150f50/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:22:39.113900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b121a-6262-4ebc-8a89-9b82dbe47da0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:39.114828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b121a-6262-4ebc-8a89-9b82dbe47da0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:39.114828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b121a-6262-4ebc-8a89-9b82dbe47da0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:39.116974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 631/1274] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:39.123128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6d46-a3e8-4778-abd3-a68ef5367901 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:39.123561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6d46-a3e8-4778-abd3-a68ef5367901 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:39.123719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6d46-a3e8-4778-abd3-a68ef5367901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:39.145689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2a2d6d46-a3e8-4778-abd3-a68ef5367901 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:39.147427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2a2d6d46-a3e8-4778-abd3-a68ef5367901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:39.227516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 644/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:39.251368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b121a-6262-4ebc-8a89-9b82dbe47da0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:39.364439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b121a-6262-4ebc-8a89-9b82dbe47da0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:39.382290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:39.400189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:39.400813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:39.401089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:39.401361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:39.412680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:22:39.417431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:39.418964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:39.419831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 632/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Aug 8 02:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:39.424830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d6d46-a3e8-4778-abd3-a68ef5367901 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:39.511051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:39.535384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d6d46-a3e8-4778-abd3-a68ef5367901 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:39.573859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:39.574455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:39.574731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:39.575014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:39.575669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:39.575969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:39.577327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:39.585861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 645/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Aug 8 02:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:39.592308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:39.704187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402076-ba7a-4e55-b02f-f9fe8aff1b7e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:39.739156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:39.739834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:39.740120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:39.740386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:39.750706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:39.752169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:39.766917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:39.767956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:39.769066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:39.769066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:39.769066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:39.769066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 633/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:39.775205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:39.894939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e14e-fa9b-4bc1-90b2-a517859c35f8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:39.929924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:39.930529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:39.930804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:39.931074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:39.931708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:39.932009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:39.933393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:39.945646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 646/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:39.952002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:39.985290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:40.057263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b05265-9dff-4cb2-b31d-06853b814c83 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.091097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.091701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.091971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.092235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.099520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.100968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:22:40.111654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:40.112714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:40.113686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 634/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:40.120817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.127073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:40.225872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee27f0-ca11-4bec-8647-d1bcf02c692c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.261329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.261953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.262225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.262493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.263205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:40.263503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.264918 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.282340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 647/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Aug 8 02:22:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:40.288621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.378511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:40.392075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc677b1-17d6-4133-b401-a1ec7ddb74fe None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.426293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.426892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.427355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.427497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.494593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.495993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.590599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:40.601411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 635/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Aug 8 02:22:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:22:40.608360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.678957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:40.734744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cb035-fc70-421b-9232-4b107ac3fc0f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.771343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.771895 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.772168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.772431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.783765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.786188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:22:40.802335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:40.803386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:22:40.804460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:22:40.804460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:22:40.804460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:40.804460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 648/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:40.809247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:40.916478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fee3e-ce67-4e51-b276-d347c8d00958 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:40.949857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:40.950450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:40.950724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:40.950992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:40.951621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:40.951919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:40.953283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:40.964769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 636/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Aug 8 02:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:40.974120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.083841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d29b1-56e7-4a95-8037-dc95b41bc1f5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.097823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:41.119614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.120231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.120512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.120783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.127944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.129402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:22:41.141133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:41.142166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: ERROR keystone.server.flask.application Aug 08 02:22:41.143152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 649/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Aug 8 02:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:41.148906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.200748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:41.255538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dba87f-b2ff-44a4-8cf6-ec943c756353 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.293806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a9707-a751-4734-97f7-b16fe4d2fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.294411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9707-a751-4734-97f7-b16fe4d2fc5f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.294690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9707-a751-4734-97f7-b16fe4d2fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.294958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9707-a751-4734-97f7-b16fe4d2fc5f None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.295651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9707-a751-4734-97f7-b16fe4d2fc5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:41.295956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9707-a751-4734-97f7-b16fe4d2fc5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.297413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9707-a751-4734-97f7-b16fe4d2fc5f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.310910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 637/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Aug 8 02:22:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:41.317234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:41.424851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d2fb5-df0e-41d8-94d0-5e7135360dd6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:41.462775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2aade-5896-4303-8fc1-f6ae011d3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:41.463357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2aade-5896-4303-8fc1-f6ae011d3e87 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:41.463632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2aade-5896-4303-8fc1-f6ae011d3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:41.463890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2aade-5896-4303-8fc1-f6ae011d3e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:41.464601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2aade-5896-4303-8fc1-f6ae011d3e87 None admin] RBAC: Adding query filter params (role.id=1470302d39e340299072b424021b764b, scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5, user.id=624d4aaae75d49a59610ebc30d150f50) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:41.464909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2aade-5896-4303-8fc1-f6ae011d3e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:41.466346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2aade-5896-4303-8fc1-f6ae011d3e87 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:41.472164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 650/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Aug 8 02:22:41 2022] GET /identity/v3/role_assignments?user.id=624d4aaae75d49a59610ebc30d150f50&scope.project.id=ed167140af4d4039b6aa4a7d0ef9cfd5&role.id=1470302d39e340299072b424021b764b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:43.459352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ee508-7fd2-4e8d-92d2-00813a0e6b42 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.460042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ee508-7fd2-4e8d-92d2-00813a0e6b42 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.460042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ee508-7fd2-4e8d-92d2-00813a0e6b42 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.461240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 638/1288] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:43.467649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908b47b-1a6f-4603-8136-a758530a76f5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.468338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908b47b-1a6f-4603-8136-a758530a76f5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.468515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908b47b-1a6f-4603-8136-a758530a76f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.495403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f908b47b-1a6f-4603-8136-a758530a76f5 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:43.496575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f908b47b-1a6f-4603-8136-a758530a76f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:43.528940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:43.568745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 651/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:43.591350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ee508-7fd2-4e8d-92d2-00813a0e6b42 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.700060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ee508-7fd2-4e8d-92d2-00813a0e6b42 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.711610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:43.738141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.738761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.739035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.739304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.739882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.741276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:43.750395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:43.751468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:43.752682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 639/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:22:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:43.757940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908b47b-1a6f-4603-8136-a758530a76f5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:43.870458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908b47b-1a6f-4603-8136-a758530a76f5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:43.907694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ae831-e0f9-4d71-8767-c98752a454a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:43.908296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae831-e0f9-4d71-8767-c98752a454a4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:43.908573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae831-e0f9-4d71-8767-c98752a454a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:43.908846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae831-e0f9-4d71-8767-c98752a454a4 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:43.909496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae831-e0f9-4d71-8767-c98752a454a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:43.909801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae831-e0f9-4d71-8767-c98752a454a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:43.911174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae831-e0f9-4d71-8767-c98752a454a4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:43.916766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 652/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Aug 8 02:22:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:43.922869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:44.031809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49975d-b53a-4b95-b68e-4f2d27d579ae None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:44.069812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7fe5-e189-41ff-86af-f2aa6098b308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:44.070406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7fe5-e189-41ff-86af-f2aa6098b308 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:44.070690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7fe5-e189-41ff-86af-f2aa6098b308 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:44.071309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7fe5-e189-41ff-86af-f2aa6098b308 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:44.071924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d7fe5-e189-41ff-86af-f2aa6098b308 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:44.072230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d7fe5-e189-41ff-86af-f2aa6098b308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:44.073619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d7fe5-e189-41ff-86af-f2aa6098b308 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:44.078099 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 640/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Aug 8 02:22:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:46.054784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa757f75-5490-4416-b245-dae0727b3d73 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.055641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa757f75-5490-4416-b245-dae0727b3d73 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.055641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa757f75-5490-4416-b245-dae0727b3d73 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.057839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 653/1293] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:46.064155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b2f21-2cc0-4de4-9ee2-58ef4b298f55 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.064894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b2f21-2cc0-4de4-9ee2-58ef4b298f55 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.065019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b2f21-2cc0-4de4-9ee2-58ef4b298f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.085522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d06b2f21-2cc0-4de4-9ee2-58ef4b298f55 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:46.086712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d06b2f21-2cc0-4de4-9ee2-58ef4b298f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:46.119086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:46.162038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 641/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:46.197341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa757f75-5490-4416-b245-dae0727b3d73 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:46.235445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:46.314006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa757f75-5490-4416-b245-dae0727b3d73 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:46.351223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e65ccf-3fe8-48e2-a98c-1a2e0b0e1df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:46.351929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e65ccf-3fe8-48e2-a98c-1a2e0b0e1df9 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:46.352238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e65ccf-3fe8-48e2-a98c-1a2e0b0e1df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:46.352565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e65ccf-3fe8-48e2-a98c-1a2e0b0e1df9 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:46.353319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e65ccf-3fe8-48e2-a98c-1a2e0b0e1df9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:46.354821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e65ccf-3fe8-48e2-a98c-1a2e0b0e1df9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:46.371770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 654/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Aug 8 02:22:46 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:22:48.356284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3118-e006-4167-8fb7-740a9a1aa15e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.357212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3118-e006-4167-8fb7-740a9a1aa15e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.357212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3118-e006-4167-8fb7-740a9a1aa15e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.359347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 642/1296] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:48.364735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85ea1-957d-442b-bdbd-b3eb707d7cbf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.365322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85ea1-957d-442b-bdbd-b3eb707d7cbf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.365322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85ea1-957d-442b-bdbd-b3eb707d7cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.384923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e6e85ea1-957d-442b-bdbd-b3eb707d7cbf None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:48.386126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e6e85ea1-957d-442b-bdbd-b3eb707d7cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:48.463544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 655/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:48.486767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3118-e006-4167-8fb7-740a9a1aa15e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:48.590627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3118-e006-4167-8fb7-740a9a1aa15e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:48.628003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:48.628909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.629276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.629672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.630904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:48.632917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:48.646588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:48.647798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:48.648895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 643/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:22:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:48.653913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85ea1-957d-442b-bdbd-b3eb707d7cbf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:48.672598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:48.763812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85ea1-957d-442b-bdbd-b3eb707d7cbf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:48.803324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:48.803924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.804200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.804472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.805108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:48.805419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:48.806809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:48.811959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 656/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Aug 8 02:22:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:48.818743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:48.856127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:48.927870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546a0b1-98fb-421a-9dc2-47f662ba741b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:48.965866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568996dd-3b86-4849-ad75-6d35e539bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:48.966470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568996dd-3b86-4849-ad75-6d35e539bccc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:48.966747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568996dd-3b86-4849-ad75-6d35e539bccc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:48.967022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568996dd-3b86-4849-ad75-6d35e539bccc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:48.967738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568996dd-3b86-4849-ad75-6d35e539bccc None admin] RBAC: Adding query filter params (interface=public, service_id=9be229e8db544678b55598a37b929520, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:48.968042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568996dd-3b86-4849-ad75-6d35e539bccc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:48.969434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568996dd-3b86-4849-ad75-6d35e539bccc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:48.974517 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 644/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Aug 8 02:22:48 2022] GET /identity/v3/endpoints?service_id=9be229e8db544678b55598a37b929520&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:48.980679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:49.064162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:49.083553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633259-9e4e-4866-a911-d515a437779c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:49.117970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19acc7-a667-46ce-81f3-578b4dfa8417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:49.118561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19acc7-a667-46ce-81f3-578b4dfa8417 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:49.118834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19acc7-a667-46ce-81f3-578b4dfa8417 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:49.119101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19acc7-a667-46ce-81f3-578b4dfa8417 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:49.119695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19acc7-a667-46ce-81f3-578b4dfa8417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:49.121055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19acc7-a667-46ce-81f3-578b4dfa8417 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:49.127890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 657/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Aug 8 02:22:48 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:22:51.079105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f03b-2ad7-496d-a50b-f3cf78970839 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.079962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f03b-2ad7-496d-a50b-f3cf78970839 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.079962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f03b-2ad7-496d-a50b-f3cf78970839 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.082190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 645/1302] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:22:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:22:51.087642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c077966-b2d3-46d4-8262-233c2cdeb474 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.088075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c077966-b2d3-46d4-8262-233c2cdeb474 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.088172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c077966-b2d3-46d4-8262-233c2cdeb474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.107814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4c077966-b2d3-46d4-8262-233c2cdeb474 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:22:51.108988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c077966-b2d3-46d4-8262-233c2cdeb474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:22:51.178468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 658/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:22:51.201756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f03b-2ad7-496d-a50b-f3cf78970839 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.313313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:51.323860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f03b-2ad7-496d-a50b-f3cf78970839 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.363734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce390e-12bf-4158-997d-667cc864662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.364295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce390e-12bf-4158-997d-667cc864662d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.364573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce390e-12bf-4158-997d-667cc864662d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.365355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce390e-12bf-4158-997d-667cc864662d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.365982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce390e-12bf-4158-997d-667cc864662d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.367388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce390e-12bf-4158-997d-667cc864662d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-afce390e-12bf-4158-997d-667cc864662d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:22:51.375883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:22:51.377021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 08 02:22:51.378052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 646/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Aug 8 02:22:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:22:51.383933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c077966-b2d3-46d4-8262-233c2cdeb474 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.461445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:22:51.486702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c077966-b2d3-46d4-8262-233c2cdeb474 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.521657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070178f-17ef-4728-8dcc-7798f7915d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.522267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070178f-17ef-4728-8dcc-7798f7915d7e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.522546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070178f-17ef-4728-8dcc-7798f7915d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.522819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070178f-17ef-4728-8dcc-7798f7915d7e None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.523445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070178f-17ef-4728-8dcc-7798f7915d7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:22:51.523746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070178f-17ef-4728-8dcc-7798f7915d7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.525123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070178f-17ef-4728-8dcc-7798f7915d7e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.530823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 659/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Aug 8 02:22:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:22:51.537583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce390e-12bf-4158-997d-667cc864662d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:22:51.655464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce390e-12bf-4158-997d-667cc864662d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:22:51.689958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2c2ae-6158-4b95-b179-5e17f7961545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:22:51.690546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c2ae-6158-4b95-b179-5e17f7961545 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:22:51.690817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c2ae-6158-4b95-b179-5e17f7961545 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:22:51.691085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c2ae-6158-4b95-b179-5e17f7961545 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:22:51.691714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2c2ae-6158-4b95-b179-5e17f7961545 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:22:51.693120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2c2ae-6158-4b95-b179-5e17f7961545 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:22:51.715860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 647/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:22:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:23:01.527386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=30 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:01.711581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:54.889175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbde83-7246-49cb-9dc7-d8f9cfa04935 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:54.889774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbde83-7246-49cb-9dc7-d8f9cfa04935 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:54.889774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbde83-7246-49cb-9dc7-d8f9cfa04935 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:54.896932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82857d8d-d9a4-4a0b-8175-21f395e8bfc2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:54.897422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82857d8d-d9a4-4a0b-8175-21f395e8bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:54.897529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82857d8d-d9a4-4a0b-8175-21f395e8bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:54.900404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 660/1307] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:23:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:54.972705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-82857d8d-d9a4-4a0b-8175-21f395e8bfc2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:54.974481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-82857d8d-d9a4-4a0b-8175-21f395e8bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:55.172445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 648/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:55.253779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df6c9-e9e6-48ec-a1a6-809d7c0135e2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:55.254062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df6c9-e9e6-48ec-a1a6-809d7c0135e2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:55.254335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df6c9-e9e6-48ec-a1a6-809d7c0135e2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:55.256698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 661/1309] 10.222.0.25 () {54 vars in 965 bytes} [Mon Aug 8 02:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:55.265086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ffad-0329-4882-9627-2261d09a03d9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:55.265404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ffad-0329-4882-9627-2261d09a03d9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:55.265723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ffad-0329-4882-9627-2261d09a03d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:55.427369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bd55ffad-0329-4882-9627-2261d09a03d9 None None] MFA Rules not processed for user `64c5c41465004c0a81fced6e8834a5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:55.429005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bd55ffad-0329-4882-9627-2261d09a03d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:55.451832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:55.512536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 649/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Mon Aug 8 02:23:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:55.521740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df6c9-e9e6-48ec-a1a6-809d7c0135e2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:55.523552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-514df6c9-e9e6-48ec-a1a6-809d7c0135e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:55.690438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df6c9-e9e6-48ec-a1a6-809d7c0135e2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:55.776909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c047-3da4-4a87-a4e8-633ecea63e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:55.777660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c047-3da4-4a87-a4e8-633ecea63e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:55.778011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c047-3da4-4a87-a4e8-633ecea63e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:55.778343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c047-3da4-4a87-a4e8-633ecea63e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:55.780044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fc69c047-3da4-4a87-a4e8-633ecea63e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:55.843187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:55.909787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69c047-3da4-4a87-a4e8-633ecea63e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:55.912383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69c047-3da4-4a87-a4e8-633ecea63e4e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:55.934309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 662/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:58.310393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a2ae-1183-4302-ae4d-2d9b74e8a9a4 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.311020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a2ae-1183-4302-ae4d-2d9b74e8a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.311020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a2ae-1183-4302-ae4d-2d9b74e8a9a4 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.312310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 650/1312] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:58.318844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525aa4-1d70-4032-9dea-10e337e52f6e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.319732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525aa4-1d70-4032-9dea-10e337e52f6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.319732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525aa4-1d70-4032-9dea-10e337e52f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.410490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-df525aa4-1d70-4032-9dea-10e337e52f6e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:58.411799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-df525aa4-1d70-4032-9dea-10e337e52f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:58.513551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 663/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:58.552196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a2ae-1183-4302-ae4d-2d9b74e8a9a4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:58.553798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0937a2ae-1183-4302-ae4d-2d9b74e8a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:58.672385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a2ae-1183-4302-ae4d-2d9b74e8a9a4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:58.747158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:58.749182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ef9f3-0bbf-4b5d-9795-1445d7a3ad63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:58.749812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ef9f3-0bbf-4b5d-9795-1445d7a3ad63 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:58.750097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ef9f3-0bbf-4b5d-9795-1445d7a3ad63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:58.750627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ef9f3-0bbf-4b5d-9795-1445d7a3ad63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:58.752674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e26ef9f3-0bbf-4b5d-9795-1445d7a3ad63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:58.884804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ef9f3-0bbf-4b5d-9795-1445d7a3ad63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:58.886221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ef9f3-0bbf-4b5d-9795-1445d7a3ad63 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:58.905329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 651/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:01.217718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217d80-7c37-42da-b3f6-341bb36e33f5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:01.218286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217d80-7c37-42da-b3f6-341bb36e33f5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:01.218286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217d80-7c37-42da-b3f6-341bb36e33f5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:01.220598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 664/1315] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:01.225828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e858-fad3-42d9-b93a-0ff106743877 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:01.226368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e858-fad3-42d9-b93a-0ff106743877 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:01.226368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e858-fad3-42d9-b93a-0ff106743877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:01.306802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-99a8e858-fad3-42d9-b93a-0ff106743877 None None] MFA Rules not processed for user `dff8474fbe1e4c859a1f366802002642`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:01.308031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99a8e858-fad3-42d9-b93a-0ff106743877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:01.371898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:01.417995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 652/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:01.474704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99d57-8b04-480c-a0c3-ad81635b8aae None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:01.474913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99d57-8b04-480c-a0c3-ad81635b8aae None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:01.475240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99d57-8b04-480c-a0c3-ad81635b8aae None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:01.477338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 665/1317] 10.222.0.25 () {54 vars in 965 bytes} [Mon Aug 8 02:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:01.486990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5633a-a730-4695-8fb0-e77c9a70ed34 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:01.487372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5633a-a730-4695-8fb0-e77c9a70ed34 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:01.487737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5633a-a730-4695-8fb0-e77c9a70ed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:01.587874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b4a5633a-a730-4695-8fb0-e77c9a70ed34 None None] MFA Rules not processed for user `64c5c41465004c0a81fced6e8834a5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:01.589093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b4a5633a-a730-4695-8fb0-e77c9a70ed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:01.669592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 653/1318] 10.222.0.25 () {58 vars in 1062 bytes} [Mon Aug 8 02:24:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:01.685128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99d57-8b04-480c-a0c3-ad81635b8aae None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:01.686708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42f99d57-8b04-480c-a0c3-ad81635b8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:01.697391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:01.795903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99d57-8b04-480c-a0c3-ad81635b8aae None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:01.872978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90e0ae-97c3-4b07-85ae-0416c903993c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:01.873758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90e0ae-97c3-4b07-85ae-0416c903993c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:01.874149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90e0ae-97c3-4b07-85ae-0416c903993c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:01.874476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90e0ae-97c3-4b07-85ae-0416c903993c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:01.876956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aa90e0ae-97c3-4b07-85ae-0416c903993c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:01.945056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:01.994938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90e0ae-97c3-4b07-85ae-0416c903993c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:01.996372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90e0ae-97c3-4b07-85ae-0416c903993c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:02.014978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 666/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:04.987465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e80d0-44ed-43bc-81b2-37841c32c712 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:04.988287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e80d0-44ed-43bc-81b2-37841c32c712 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:04.988287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e80d0-44ed-43bc-81b2-37841c32c712 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:04.990273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 654/1320] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:04.996802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca8f1-d4ff-48e8-96cf-1a23354c9ba0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:04.997286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca8f1-d4ff-48e8-96cf-1a23354c9ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:04.997286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca8f1-d4ff-48e8-96cf-1a23354c9ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:05.071322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2eaca8f1-d4ff-48e8-96cf-1a23354c9ba0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:05.073250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2eaca8f1-d4ff-48e8-96cf-1a23354c9ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:05.175545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 667/1321] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:24:05.218343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e80d0-44ed-43bc-81b2-37841c32c712 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:05.219893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b85e80d0-44ed-43bc-81b2-37841c32c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:05.275383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:05.349858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e80d0-44ed-43bc-81b2-37841c32c712 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:05.423556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb07ee-15b2-4744-8978-26ad779612b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:05.424169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb07ee-15b2-4744-8978-26ad779612b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:05.424439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb07ee-15b2-4744-8978-26ad779612b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:05.424677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb07ee-15b2-4744-8978-26ad779612b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:05.426361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7bdb07ee-15b2-4744-8978-26ad779612b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:05.523713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:05.542420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb07ee-15b2-4744-8978-26ad779612b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:05.543807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb07ee-15b2-4744-8978-26ad779612b7 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:05.563386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 655/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:08.300463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18aa5e-fe8d-424d-9d00-763c6b0acc6d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:08.301036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18aa5e-fe8d-424d-9d00-763c6b0acc6d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:08.301036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18aa5e-fe8d-424d-9d00-763c6b0acc6d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:08.302565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 668/1323] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:08.308005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5df3ed-3222-43d5-9030-f740c9c1971b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:08.308471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5df3ed-3222-43d5-9030-f740c9c1971b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:08.308579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5df3ed-3222-43d5-9030-f740c9c1971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:08.376441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-df5df3ed-3222-43d5-9030-f740c9c1971b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:08.377695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-df5df3ed-3222-43d5-9030-f740c9c1971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:08.484125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 656/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:08.523108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18aa5e-fe8d-424d-9d00-763c6b0acc6d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:08.524782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bc18aa5e-fe8d-424d-9d00-763c6b0acc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:08.545745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:08.640267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18aa5e-fe8d-424d-9d00-763c6b0acc6d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:08.720473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29373b9-77ea-48bd-9cb8-f886042b340a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:08.721507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29373b9-77ea-48bd-9cb8-f886042b340a service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:08.721995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29373b9-77ea-48bd-9cb8-f886042b340a service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:08.722477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29373b9-77ea-48bd-9cb8-f886042b340a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:08.725662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d29373b9-77ea-48bd-9cb8-f886042b340a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:08.802131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:08.843680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29373b9-77ea-48bd-9cb8-f886042b340a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:08.845125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29373b9-77ea-48bd-9cb8-f886042b340a service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:08.864185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 669/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:10.951086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c8aa-74ea-46f8-8938-59ee241c3ee7 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:10.951684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c8aa-74ea-46f8-8938-59ee241c3ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:10.951684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c8aa-74ea-46f8-8938-59ee241c3ee7 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:10.953152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 657/1326] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:10.958670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6b78-6cd0-4106-849e-d26475f55549 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:10.959098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6b78-6cd0-4106-849e-d26475f55549 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:10.959343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6b78-6cd0-4106-849e-d26475f55549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:11.030285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6cde6b78-6cd0-4106-849e-d26475f55549 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:11.031687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6cde6b78-6cd0-4106-849e-d26475f55549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:11.133333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 670/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:11.169593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029c8aa-74ea-46f8-8938-59ee241c3ee7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:11.171156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c029c8aa-74ea-46f8-8938-59ee241c3ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:11.235193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:11.281942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029c8aa-74ea-46f8-8938-59ee241c3ee7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:11.364615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35b0c4-19b7-41e0-9377-a5a4ae6549d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:11.365229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b0c4-19b7-41e0-9377-a5a4ae6549d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:11.365539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b0c4-19b7-41e0-9377-a5a4ae6549d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:11.365813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b0c4-19b7-41e0-9377-a5a4ae6549d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:11.367409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b35b0c4-19b7-41e0-9377-a5a4ae6549d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:11.478187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:11.480410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35b0c4-19b7-41e0-9377-a5a4ae6549d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:11.482031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35b0c4-19b7-41e0-9377-a5a4ae6549d6 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:11.501986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 658/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:13.569034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711bae-fda3-41b8-bdb2-ba297ea0f779 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:13.569974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711bae-fda3-41b8-bdb2-ba297ea0f779 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:13.569974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711bae-fda3-41b8-bdb2-ba297ea0f779 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:13.571280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 671/1329] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:13.576861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b913a5-fe1d-4349-9bfa-10d2099c2321 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:13.577264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b913a5-fe1d-4349-9bfa-10d2099c2321 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:13.577437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b913a5-fe1d-4349-9bfa-10d2099c2321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:13.649165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-20b913a5-fe1d-4349-9bfa-10d2099c2321 None None] MFA Rules not processed for user `dff8474fbe1e4c859a1f366802002642`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:13.650344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-20b913a5-fe1d-4349-9bfa-10d2099c2321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:13.751914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 659/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:13.789933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711bae-fda3-41b8-bdb2-ba297ea0f779 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:13.791559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7711bae-fda3-41b8-bdb2-ba297ea0f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:13.824897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:13.898945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711bae-fda3-41b8-bdb2-ba297ea0f779 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:13.977323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ceec1-4a19-46e8-a0a5-bcf641700ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:13.978107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ceec1-4a19-46e8-a0a5-bcf641700ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:13.978444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ceec1-4a19-46e8-a0a5-bcf641700ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:13.978778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ceec1-4a19-46e8-a0a5-bcf641700ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:13.980552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4a4ceec1-4a19-46e8-a0a5-bcf641700ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:14.063964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:14.096324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ceec1-4a19-46e8-a0a5-bcf641700ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:14.097797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ceec1-4a19-46e8-a0a5-bcf641700ac5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:14.116687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 672/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:13 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:16.460074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff98c7-6152-4847-9462-7ab796343e87 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:16.460967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff98c7-6152-4847-9462-7ab796343e87 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:16.460967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff98c7-6152-4847-9462-7ab796343e87 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:16.463198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 660/1332] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:16.469417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534293-92f1-41c5-a047-6e69045f1bcd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:16.470162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534293-92f1-41c5-a047-6e69045f1bcd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:16.470459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534293-92f1-41c5-a047-6e69045f1bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:16.559459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-09534293-92f1-41c5-a047-6e69045f1bcd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:16.560690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-09534293-92f1-41c5-a047-6e69045f1bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:16.667266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 673/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:16.708043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff98c7-6152-4847-9462-7ab796343e87 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:16.709642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c4ff98c7-6152-4847-9462-7ab796343e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:16.782849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:16.818419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff98c7-6152-4847-9462-7ab796343e87 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:16.895245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1d53d-4ef5-448e-bdb8-32a51f5c16ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:16.896341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1d53d-4ef5-448e-bdb8-32a51f5c16ac service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:16.896623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1d53d-4ef5-448e-bdb8-32a51f5c16ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:16.896991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1d53d-4ef5-448e-bdb8-32a51f5c16ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:16.899269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d5f1d53d-4ef5-448e-bdb8-32a51f5c16ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:17.011587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1d53d-4ef5-448e-bdb8-32a51f5c16ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:17.012932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1d53d-4ef5-448e-bdb8-32a51f5c16ac service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:17.024103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:17.034150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 661/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:24:19.063786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a50be7-76bf-400e-921b-0779c1d03c2d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:19.064707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a50be7-76bf-400e-921b-0779c1d03c2d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:19.064707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a50be7-76bf-400e-921b-0779c1d03c2d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:19.066991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 674/1335] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:19.073026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b972f-9f51-4e35-9ce5-6093dd2cf605 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:19.073479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b972f-9f51-4e35-9ce5-6093dd2cf605 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:19.073570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b972f-9f51-4e35-9ce5-6093dd2cf605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:19.152002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-351b972f-9f51-4e35-9ce5-6093dd2cf605 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:19.153211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-351b972f-9f51-4e35-9ce5-6093dd2cf605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:19.388772 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 662/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:24:19.434462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a50be7-76bf-400e-921b-0779c1d03c2d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:19.436972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-19a50be7-76bf-400e-921b-0779c1d03c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:19.488012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:19.576644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a50be7-76bf-400e-921b-0779c1d03c2d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:19.662993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0a287-a05c-4e30-b97b-ef1385a6fd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:19.664373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a287-a05c-4e30-b97b-ef1385a6fd78 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:19.664658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a287-a05c-4e30-b97b-ef1385a6fd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:19.664932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a287-a05c-4e30-b97b-ef1385a6fd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:19.666588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-72e0a287-a05c-4e30-b97b-ef1385a6fd78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:19.754744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:19.782884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a287-a05c-4e30-b97b-ef1385a6fd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:19.784343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a287-a05c-4e30-b97b-ef1385a6fd78 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:19.802975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 675/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:22.174251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adf4fe-c298-4659-9952-576c7c908650 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:22.175170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adf4fe-c298-4659-9952-576c7c908650 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:22.175170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adf4fe-c298-4659-9952-576c7c908650 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:22.178379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 663/1338] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:22.184439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3a8e-db6d-4844-b2f8-7d8cf2e319e3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:22.185200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3a8e-db6d-4844-b2f8-7d8cf2e319e3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:22.185345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3a8e-db6d-4844-b2f8-7d8cf2e319e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:22.257733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-018a3a8e-db6d-4844-b2f8-7d8cf2e319e3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:22.258949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-018a3a8e-db6d-4844-b2f8-7d8cf2e319e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:22.371090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 676/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:22.416637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adf4fe-c298-4659-9952-576c7c908650 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:22.418211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e3adf4fe-c298-4659-9952-576c7c908650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:22.507972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:22.539663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adf4fe-c298-4659-9952-576c7c908650 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:22.615304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e5974-62e4-47a5-8e0c-242b0861b753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:22.615925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5974-62e4-47a5-8e0c-242b0861b753 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:22.616201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5974-62e4-47a5-8e0c-242b0861b753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:22.616445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5974-62e4-47a5-8e0c-242b0861b753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:22.618135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-776e5974-62e4-47a5-8e0c-242b0861b753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:22.741799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e5974-62e4-47a5-8e0c-242b0861b753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:22.743550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e5974-62e4-47a5-8e0c-242b0861b753 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:22.761020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 664/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:26.865242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee218-4abf-44f4-9e4c-17fc3bbfbd1c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:26.865867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee218-4abf-44f4-9e4c-17fc3bbfbd1c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:26.865867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee218-4abf-44f4-9e4c-17fc3bbfbd1c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:26.867339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 677/1341] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:26.872507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd13cf-2b4b-429a-99fe-620c47d4efa3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:26.872994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd13cf-2b4b-429a-99fe-620c47d4efa3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:26.872994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd13cf-2b4b-429a-99fe-620c47d4efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:26.878759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:26.952616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9fdd13cf-2b4b-429a-99fe-620c47d4efa3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:26.953889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9fdd13cf-2b4b-429a-99fe-620c47d4efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.055776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 665/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:27.095382 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee218-4abf-44f4-9e4c-17fc3bbfbd1c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:27.096933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a87ee218-4abf-44f4-9e4c-17fc3bbfbd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.152146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:27.209309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee218-4abf-44f4-9e4c-17fc3bbfbd1c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:27.283557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517e6b0-a748-4ba4-ac88-efc13d29e083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:27.284185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517e6b0-a748-4ba4-ac88-efc13d29e083 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:27.284460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517e6b0-a748-4ba4-ac88-efc13d29e083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:27.284728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517e6b0-a748-4ba4-ac88-efc13d29e083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:27.286489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0517e6b0-a748-4ba4-ac88-efc13d29e083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:27.385644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:27.402536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517e6b0-a748-4ba4-ac88-efc13d29e083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:27.403896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517e6b0-a748-4ba4-ac88-efc13d29e083 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:27.423534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 678/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:30.113922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cb4dc-f206-40a0-8985-9ed5cbb06185 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:30.114594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cb4dc-f206-40a0-8985-9ed5cbb06185 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:30.114594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cb4dc-f206-40a0-8985-9ed5cbb06185 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:30.116065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 666/1344] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:30.121957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e5ae-820f-4f88-a30a-996445ca0393 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:30.122528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e5ae-820f-4f88-a30a-996445ca0393 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:30.122528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e5ae-820f-4f88-a30a-996445ca0393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:30.204873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2e03e5ae-820f-4f88-a30a-996445ca0393 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:30.206193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2e03e5ae-820f-4f88-a30a-996445ca0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:30.308839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 679/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:30.346415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cb4dc-f206-40a0-8985-9ed5cbb06185 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:30.348027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-db1cb4dc-f206-40a0-8985-9ed5cbb06185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:30.443087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:30.461901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cb4dc-f206-40a0-8985-9ed5cbb06185 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:30.538154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f49d-4c37-41cd-a1d1-976b5da53953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:30.538678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f49d-4c37-41cd-a1d1-976b5da53953 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:30.538952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f49d-4c37-41cd-a1d1-976b5da53953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:30.539213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f49d-4c37-41cd-a1d1-976b5da53953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:30.540861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-02f3f49d-4c37-41cd-a1d1-976b5da53953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:30.651233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f49d-4c37-41cd-a1d1-976b5da53953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:30.652671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f49d-4c37-41cd-a1d1-976b5da53953 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:30.672049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 667/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:34.875003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a508e0-ef7f-4020-b82d-5da9a87bfc6e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:34.875528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a508e0-ef7f-4020-b82d-5da9a87bfc6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:34.875528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a508e0-ef7f-4020-b82d-5da9a87bfc6e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:34.877675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 680/1347] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:34.882953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7ee9-4f77-470c-9ace-eae05c1dcba9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:34.883445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7ee9-4f77-470c-9ace-eae05c1dcba9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:34.883527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7ee9-4f77-470c-9ace-eae05c1dcba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:34.901049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:34.967232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-623d7ee9-4f77-470c-9ace-eae05c1dcba9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:34.968461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-623d7ee9-4f77-470c-9ace-eae05c1dcba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:35.068491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 668/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:35.106915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a508e0-ef7f-4020-b82d-5da9a87bfc6e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:35.108550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-61a508e0-ef7f-4020-b82d-5da9a87bfc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:35.169683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:35.222182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a508e0-ef7f-4020-b82d-5da9a87bfc6e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:35.300921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e51e62-c628-47d1-8aed-3885ea6b3fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:35.301585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e51e62-c628-47d1-8aed-3885ea6b3fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:35.301946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e51e62-c628-47d1-8aed-3885ea6b3fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:35.302223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e51e62-c628-47d1-8aed-3885ea6b3fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:35.303876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-86e51e62-c628-47d1-8aed-3885ea6b3fd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:35.415377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:35.421012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e51e62-c628-47d1-8aed-3885ea6b3fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:35.422541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e51e62-c628-47d1-8aed-3885ea6b3fd2 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:35.443400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 681/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:40.323763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1300b1-5065-4085-840f-360fb4b3631f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:40.324740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1300b1-5065-4085-840f-360fb4b3631f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:40.325207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1300b1-5065-4085-840f-360fb4b3631f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:40.327012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 669/1350] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:40.334485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8b49-f7e6-450f-be41-0c9988809a37 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:40.334953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8b49-f7e6-450f-be41-0c9988809a37 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:40.335035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8b49-f7e6-450f-be41-0c9988809a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:40.482740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-093a8b49-f7e6-450f-be41-0c9988809a37 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:40.484261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-093a8b49-f7e6-450f-be41-0c9988809a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:40.610038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 682/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:24:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:24:44.809572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8122-5d49-4a3a-9376-3343191a913a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:44.810129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8122-5d49-4a3a-9376-3343191a913a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:44.810129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8122-5d49-4a3a-9376-3343191a913a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:44.811875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 670/1352] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:44.816816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a7139-57de-4035-be80-3c4f8f3919a5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:44.817245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a7139-57de-4035-be80-3c4f8f3919a5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:44.817601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a7139-57de-4035-be80-3c4f8f3919a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:44.875653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:44.903161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e52a7139-57de-4035-be80-3c4f8f3919a5 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:44.904570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e52a7139-57de-4035-be80-3c4f8f3919a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:45.023124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 683/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:24:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:45.066488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=59 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:46.191466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689283-3093-46a9-8170-fb9aeae15beb None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:46.192119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689283-3093-46a9-8170-fb9aeae15beb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:46.192119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689283-3093-46a9-8170-fb9aeae15beb None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:46.193510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 671/1354] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:46.198990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4f94a-21b5-455a-9956-bee1963aaa96 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:46.199414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4f94a-21b5-455a-9956-bee1963aaa96 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:46.199512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4f94a-21b5-455a-9956-bee1963aaa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:46.276592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d8e4f94a-21b5-455a-9956-bee1963aaa96 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:46.277840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d8e4f94a-21b5-455a-9956-bee1963aaa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:46.320712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:46.384270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 684/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:24:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:24:49.831540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f397e-4b01-4a6a-94c7-8515ffb93018 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:49.832097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f397e-4b01-4a6a-94c7-8515ffb93018 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:49.832097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f397e-4b01-4a6a-94c7-8515ffb93018 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:49.833628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 672/1356] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:49.838835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74065b-2450-4666-b8ba-7dd34f0571ac None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:49.839219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74065b-2450-4666-b8ba-7dd34f0571ac None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:49.842970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74065b-2450-4666-b8ba-7dd34f0571ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:49.939255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9b74065b-2450-4666-b8ba-7dd34f0571ac None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:49.940719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9b74065b-2450-4666-b8ba-7dd34f0571ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:50.051112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 685/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:50.108067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220c8b-ad37-47b9-b064-3fea1183d65f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:50.109003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220c8b-ad37-47b9-b064-3fea1183d65f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:50.109626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220c8b-ad37-47b9-b064-3fea1183d65f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:50.111301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 673/1358] 10.222.0.25 () {54 vars in 962 bytes} [Mon Aug 8 02:24:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:50.121613 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f86463-e1bd-47b3-a536-f4e2e92804bd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:50.122839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f86463-e1bd-47b3-a536-f4e2e92804bd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:50.123316 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f86463-e1bd-47b3-a536-f4e2e92804bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:50.141903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:50.214000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-25f86463-e1bd-47b3-a536-f4e2e92804bd None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:50.215119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-25f86463-e1bd-47b3-a536-f4e2e92804bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:50.353556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 686/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Aug 8 02:24:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:50.361140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220c8b-ad37-47b9-b064-3fea1183d65f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:50.363066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cc220c8b-ad37-47b9-b064-3fea1183d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:50.522416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220c8b-ad37-47b9-b064-3fea1183d65f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:50.620819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:50.675380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544460d-2888-4be0-a395-7cad80af04cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:50.676091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544460d-2888-4be0-a395-7cad80af04cc service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:50.676431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544460d-2888-4be0-a395-7cad80af04cc service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:50.676825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544460d-2888-4be0-a395-7cad80af04cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:50.678477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d544460d-2888-4be0-a395-7cad80af04cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:50.774518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544460d-2888-4be0-a395-7cad80af04cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:50.776146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544460d-2888-4be0-a395-7cad80af04cc service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:50.795027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 674/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:53.021108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fffc32-40e7-4dae-b71a-a449a43d082f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:53.021621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fffc32-40e7-4dae-b71a-a449a43d082f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:53.022552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fffc32-40e7-4dae-b71a-a449a43d082f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:53.024128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 687/1361] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:53.029563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cd95-ae5d-44b0-acf0-fd840c294bf8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:53.030008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cd95-ae5d-44b0-acf0-fd840c294bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:53.030308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cd95-ae5d-44b0-acf0-fd840c294bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:53.102429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7039cd95-ae5d-44b0-acf0-fd840c294bf8 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:53.103631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7039cd95-ae5d-44b0-acf0-fd840c294bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:53.142867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:53.217422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 675/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:53.262011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fffc32-40e7-4dae-b71a-a449a43d082f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:53.263417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-78fffc32-40e7-4dae-b71a-a449a43d082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:53.339037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:53.433779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fffc32-40e7-4dae-b71a-a449a43d082f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:53.583488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14ebb2-5bd1-49ba-bddc-126544485e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:53.584242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14ebb2-5bd1-49ba-bddc-126544485e9c service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:53.584523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14ebb2-5bd1-49ba-bddc-126544485e9c service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:53.584795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14ebb2-5bd1-49ba-bddc-126544485e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:53.586444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fb14ebb2-5bd1-49ba-bddc-126544485e9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:53.610309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:53.693216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14ebb2-5bd1-49ba-bddc-126544485e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:53.695418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14ebb2-5bd1-49ba-bddc-126544485e9c service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:53.714992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 688/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:56.058165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a96c1-3ee8-4bd6-a289-6302de3df428 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:56.058722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a96c1-3ee8-4bd6-a289-6302de3df428 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:56.058722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a96c1-3ee8-4bd6-a289-6302de3df428 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:56.060050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 676/1364] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:56.065593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfe128-956d-4142-932f-c9143a58de2a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:56.066026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfe128-956d-4142-932f-c9143a58de2a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:56.066222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfe128-956d-4142-932f-c9143a58de2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:56.141422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f2dfe128-956d-4142-932f-c9143a58de2a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:56.141422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f2dfe128-956d-4142-932f-c9143a58de2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:56.245006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:56.249412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 689/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:56.293741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea891e-b351-438c-bef2-08b8e6c8eebb None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:56.294312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea891e-b351-438c-bef2-08b8e6c8eebb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:56.294312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea891e-b351-438c-bef2-08b8e6c8eebb None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:56.295841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 677/1366] 10.222.0.25 () {54 vars in 962 bytes} [Mon Aug 8 02:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:56.301767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8084ec-c64d-4d75-8427-26b557e5d7ed None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:56.302205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8084ec-c64d-4d75-8427-26b557e5d7ed None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:56.302760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8084ec-c64d-4d75-8427-26b557e5d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:56.382059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8d8084ec-c64d-4d75-8427-26b557e5d7ed None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:56.383154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d8084ec-c64d-4d75-8427-26b557e5d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:56.503260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 690/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Aug 8 02:24:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:56.512162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea891e-b351-438c-bef2-08b8e6c8eebb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:56.513834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e9ea891e-b351-438c-bef2-08b8e6c8eebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:56.679431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea891e-b351-438c-bef2-08b8e6c8eebb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:56.700817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:56.799499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc325fd7-e63a-4c22-9a27-43b03d350074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:56.800112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc325fd7-e63a-4c22-9a27-43b03d350074 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:56.800387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc325fd7-e63a-4c22-9a27-43b03d350074 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:56.800654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc325fd7-e63a-4c22-9a27-43b03d350074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:56.802461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dc325fd7-e63a-4c22-9a27-43b03d350074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:56.897252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc325fd7-e63a-4c22-9a27-43b03d350074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:56.898883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc325fd7-e63a-4c22-9a27-43b03d350074 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:56.917595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 678/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:58.078866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d544ab-a458-420d-9303-d00da3c7dd48 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.079890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d544ab-a458-420d-9303-d00da3c7dd48 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.080212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d544ab-a458-420d-9303-d00da3c7dd48 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.081840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 691/1369] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:58.087906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002e157-76ad-4793-9062-c03e4bd6c828 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.088470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002e157-76ad-4793-9062-c03e4bd6c828 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.088470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002e157-76ad-4793-9062-c03e4bd6c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.124269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:58.161469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1002e157-76ad-4793-9062-c03e4bd6c828 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:58.162709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1002e157-76ad-4793-9062-c03e4bd6c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:58.274177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 679/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:58.621314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05c88-16e5-495d-9ffb-d6c12b11e628 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.624318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05c88-16e5-495d-9ffb-d6c12b11e628 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.626357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05c88-16e5-495d-9ffb-d6c12b11e628 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.628425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 692/1371] 10.222.0.25 () {54 vars in 964 bytes} [Mon Aug 8 02:24:58 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:24:58.633483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08fb8a-58bb-4663-89e9-3f73d70108fb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.633721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08fb8a-58bb-4663-89e9-3f73d70108fb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.634032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08fb8a-58bb-4663-89e9-3f73d70108fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.716057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9e08fb8a-58bb-4663-89e9-3f73d70108fb None None] MFA Rules not processed for user `913aaeebb773479e8c4cb64bb588fa34`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:58.717278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9e08fb8a-58bb-4663-89e9-3f73d70108fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:58.768788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:58.801134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 680/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Aug 8 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:24:58.808950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05c88-16e5-495d-9ffb-d6c12b11e628 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:58.810506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d7e05c88-16e5-495d-9ffb-d6c12b11e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:58.865922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:58.923692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05c88-16e5-495d-9ffb-d6c12b11e628 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:58.979336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106ac52-154d-4a47-8d5c-60542c84b394 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.979621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106ac52-154d-4a47-8d5c-60542c84b394 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.979923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106ac52-154d-4a47-8d5c-60542c84b394 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:58.982151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 681/1373] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:24:58.987046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22692f18-41f8-4449-b26c-e7e7bf16c60b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:58.987339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22692f18-41f8-4449-b26c-e7e7bf16c60b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:58.987612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22692f18-41f8-4449-b26c-e7e7bf16c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.018837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.019470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.019866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.020002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.021931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.067744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-22692f18-41f8-4449-b26c-e7e7bf16c60b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:24:59.068958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-22692f18-41f8-4449-b26c-e7e7bf16c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.135232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:59.152353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.153901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.172539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 693/1374] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:24:59.186311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 682/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:24:59.233974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:24:59.235089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.335101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c572-ab68-4801-9465-5eca7a4dcf89 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:24:59.439103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:24:59.452963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83c6e7-caea-4a41-92aa-090e8891fa22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:24:59.453619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c6e7-caea-4a41-92aa-090e8891fa22 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:24:59.453899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c6e7-caea-4a41-92aa-090e8891fa22 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:24:59.454168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c6e7-caea-4a41-92aa-090e8891fa22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:24:59.455773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3f83c6e7-caea-4a41-92aa-090e8891fa22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:24:59.546102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83c6e7-caea-4a41-92aa-090e8891fa22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:24:59.547705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83c6e7-caea-4a41-92aa-090e8891fa22 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:24:59.565911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 694/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:01.581216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866294d-908b-4acd-a210-c2b9fea83262 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:01.581749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866294d-908b-4acd-a210-c2b9fea83262 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:01.581876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866294d-908b-4acd-a210-c2b9fea83262 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:01.583358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 683/1377] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:01.588919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbd433-94a9-43dc-a229-855ff5bbe020 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:01.589757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbd433-94a9-43dc-a229-855ff5bbe020 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:01.590001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbd433-94a9-43dc-a229-855ff5bbe020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:01.663110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-efbbd433-94a9-43dc-a229-855ff5bbe020 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:01.663816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-efbbd433-94a9-43dc-a229-855ff5bbe020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:01.752025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:01.794435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 695/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:01.838976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866294d-908b-4acd-a210-c2b9fea83262 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:01.840465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8866294d-908b-4acd-a210-c2b9fea83262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:01.894007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:01.990267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866294d-908b-4acd-a210-c2b9fea83262 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:02.149125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f3cae-91bc-4011-8fd3-e983ceed68b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:02.150160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f3cae-91bc-4011-8fd3-e983ceed68b1 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:02.150160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f3cae-91bc-4011-8fd3-e983ceed68b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:02.150354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f3cae-91bc-4011-8fd3-e983ceed68b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:02.151895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b31f3cae-91bc-4011-8fd3-e983ceed68b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:02.165985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:02.262192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f3cae-91bc-4011-8fd3-e983ceed68b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:02.263745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f3cae-91bc-4011-8fd3-e983ceed68b1 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:02.281825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 684/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:04.331206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6bc4-27b5-4479-a3a1-a30e9cb3f3ad None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.331766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6bc4-27b5-4479-a3a1-a30e9cb3f3ad None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.331766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6bc4-27b5-4479-a3a1-a30e9cb3f3ad None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.333264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 696/1380] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:04.338805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4653e0-dcc2-4476-85fa-d54d7e5ddff7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.339269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4653e0-dcc2-4476-85fa-d54d7e5ddff7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.339361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4653e0-dcc2-4476-85fa-d54d7e5ddff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.408005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ec4653e0-dcc2-4476-85fa-d54d7e5ddff7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:04.409204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ec4653e0-dcc2-4476-85fa-d54d7e5ddff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:04.497195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:04.510231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 685/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:04.554296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b6bc4-27b5-4479-a3a1-a30e9cb3f3ad None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.555892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-356b6bc4-27b5-4479-a3a1-a30e9cb3f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:04.722334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b6bc4-27b5-4479-a3a1-a30e9cb3f3ad None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.780478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:04.853944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7ad50-0590-45c7-a3a0-60a186935c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.854575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7ad50-0590-45c7-a3a0-60a186935c6c service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.854933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7ad50-0590-45c7-a3a0-60a186935c6c service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.855207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7ad50-0590-45c7-a3a0-60a186935c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.856825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0a7ad50-0590-45c7-a3a0-60a186935c6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:04.949340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7ad50-0590-45c7-a3a0-60a186935c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.951031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7ad50-0590-45c7-a3a0-60a186935c6c service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.970527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 697/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:07.057279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561fa5e-0289-47d0-9cac-8217799c68fe None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.057279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561fa5e-0289-47d0-9cac-8217799c68fe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.057279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561fa5e-0289-47d0-9cac-8217799c68fe None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.057279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 686/1383] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:07.063329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f1523-d25b-4821-983d-3d083f5141dd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.064380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f1523-d25b-4821-983d-3d083f5141dd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.064666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f1523-d25b-4821-983d-3d083f5141dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.149451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-013f1523-d25b-4821-983d-3d083f5141dd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:07.150738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-013f1523-d25b-4821-983d-3d083f5141dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:07.153000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:07.284716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 698/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:07.336241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561fa5e-0289-47d0-9cac-8217799c68fe None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.337900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1561fa5e-0289-47d0-9cac-8217799c68fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:07.496999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561fa5e-0289-47d0-9cac-8217799c68fe None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.561842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:07.618069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46357eb-d6d7-49a2-9a2d-c4c1e3666cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.618539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46357eb-d6d7-49a2-9a2d-c4c1e3666cef service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.618816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46357eb-d6d7-49a2-9a2d-c4c1e3666cef service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.619095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46357eb-d6d7-49a2-9a2d-c4c1e3666cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.620739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d46357eb-d6d7-49a2-9a2d-c4c1e3666cef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:07.712029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46357eb-d6d7-49a2-9a2d-c4c1e3666cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.713832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46357eb-d6d7-49a2-9a2d-c4c1e3666cef service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.737685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 687/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:10.242138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5692-7ea9-4fd8-beab-6ec680b777bb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:10.242732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5692-7ea9-4fd8-beab-6ec680b777bb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:10.242824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5692-7ea9-4fd8-beab-6ec680b777bb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:10.244535 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 699/1386] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:10.251261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c167e9-b3f8-4e2c-8804-a73c87b9fe7e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:10.251723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c167e9-b3f8-4e2c-8804-a73c87b9fe7e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:10.252185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c167e9-b3f8-4e2c-8804-a73c87b9fe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:10.337040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d2c167e9-b3f8-4e2c-8804-a73c87b9fe7e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:10.338308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d2c167e9-b3f8-4e2c-8804-a73c87b9fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:10.367842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:10.448269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 688/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:10.499649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d5692-7ea9-4fd8-beab-6ec680b777bb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:10.501584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1f2d5692-7ea9-4fd8-beab-6ec680b777bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:10.659032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:10.678357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d5692-7ea9-4fd8-beab-6ec680b777bb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:10.806190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0437b6-05de-46e0-9fc8-db80d24bfe25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:10.806904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0437b6-05de-46e0-9fc8-db80d24bfe25 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:10.807186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0437b6-05de-46e0-9fc8-db80d24bfe25 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:10.807454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0437b6-05de-46e0-9fc8-db80d24bfe25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:10.809056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5f0437b6-05de-46e0-9fc8-db80d24bfe25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:10.920487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0437b6-05de-46e0-9fc8-db80d24bfe25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:10.922479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0437b6-05de-46e0-9fc8-db80d24bfe25 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:10.928636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:10.946125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 700/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:13.075098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c805c-ae6e-4246-8858-150d6a2aae1f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:13.075704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c805c-ae6e-4246-8858-150d6a2aae1f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:13.075704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c805c-ae6e-4246-8858-150d6a2aae1f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:13.076989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 689/1389] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:13.082241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c351504-c5cf-4875-899d-09debe746c17 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:13.082677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c351504-c5cf-4875-899d-09debe746c17 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:13.082772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c351504-c5cf-4875-899d-09debe746c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:13.163560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3c351504-c5cf-4875-899d-09debe746c17 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:13.164797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3c351504-c5cf-4875-899d-09debe746c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:13.275157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 701/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:13.324013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c805c-ae6e-4246-8858-150d6a2aae1f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:13.325641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-820c805c-ae6e-4246-8858-150d6a2aae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:13.487360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c805c-ae6e-4246-8858-150d6a2aae1f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:13.496690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:13.602453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025f12-de45-4c13-a9c4-76ee6100a7eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:13.602970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025f12-de45-4c13-a9c4-76ee6100a7eb service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:13.603246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025f12-de45-4c13-a9c4-76ee6100a7eb service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:13.603517 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025f12-de45-4c13-a9c4-76ee6100a7eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:13.605104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-95025f12-de45-4c13-a9c4-76ee6100a7eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:13.709118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025f12-de45-4c13-a9c4-76ee6100a7eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:13.710851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025f12-de45-4c13-a9c4-76ee6100a7eb service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:13.730134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 690/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:14.243060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee4850-808d-4cd1-bdd7-87d8c502c02c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.243600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee4850-808d-4cd1-bdd7-87d8c502c02c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.243600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee4850-808d-4cd1-bdd7-87d8c502c02c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.244985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 702/1392] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:14.250247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5734719-13e4-4746-8cea-24f3a08170eb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.250767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5734719-13e4-4746-8cea-24f3a08170eb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.250767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5734719-13e4-4746-8cea-24f3a08170eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.266639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:14.319329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c5734719-13e4-4746-8cea-24f3a08170eb None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:14.320885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c5734719-13e4-4746-8cea-24f3a08170eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:14.416423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 691/1393] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:14.472903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadb7a-b1ca-4c45-9f7f-16e46c6e5a87 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.473186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadb7a-b1ca-4c45-9f7f-16e46c6e5a87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.473635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadb7a-b1ca-4c45-9f7f-16e46c6e5a87 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.475630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 703/1394] 10.222.0.25 () {54 vars in 966 bytes} [Mon Aug 8 02:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:14.480903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63d06-0da5-44d4-afcf-e49a42e24913 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.481271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63d06-0da5-44d4-afcf-e49a42e24913 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.481580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63d06-0da5-44d4-afcf-e49a42e24913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.559140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3bb63d06-0da5-44d4-afcf-e49a42e24913 None None] MFA Rules not processed for user `2d691f1a09e14fc5a1858b1ac3bdd026`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:14.560355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3bb63d06-0da5-44d4-afcf-e49a42e24913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:14.597747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:14.644379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 692/1395] 10.222.0.25 () {58 vars in 1063 bytes} [Mon Aug 8 02:25:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:14.652392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fadb7a-b1ca-4c45-9f7f-16e46c6e5a87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:14.654002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-64fadb7a-b1ca-4c45-9f7f-16e46c6e5a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:14.730195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:14.762758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fadb7a-b1ca-4c45-9f7f-16e46c6e5a87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:14.839358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c761dc1-886e-4d32-8f7a-dcd9c9b43897 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:14.839975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c761dc1-886e-4d32-8f7a-dcd9c9b43897 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.840250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c761dc1-886e-4d32-8f7a-dcd9c9b43897 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.840516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c761dc1-886e-4d32-8f7a-dcd9c9b43897 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.842163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c761dc1-886e-4d32-8f7a-dcd9c9b43897 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:14.959635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c761dc1-886e-4d32-8f7a-dcd9c9b43897 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:14.961083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c761dc1-886e-4d32-8f7a-dcd9c9b43897 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:14.977049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:14.980308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 704/1396] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:15.720190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2794c1-fc29-49c1-989e-d56070378667 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.720692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2794c1-fc29-49c1-989e-d56070378667 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.720692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2794c1-fc29-49c1-989e-d56070378667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.785004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa6dd-3e6c-4923-a108-5c6a9956f285 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.785573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa6dd-3e6c-4923-a108-5c6a9956f285 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.785573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa6dd-3e6c-4923-a108-5c6a9956f285 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.787018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 705/1397] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:25:15.789798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fe2794c1-fc29-49c1-989e-d56070378667 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:15.791104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fe2794c1-fc29-49c1-989e-d56070378667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:15.792238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.792516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.792792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.862761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:15.864026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:15.880879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 693/1398] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:15.930718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca84efe-f124-4a90-80e1-d71a5d12dc0f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.931090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca84efe-f124-4a90-80e1-d71a5d12dc0f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.931379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca84efe-f124-4a90-80e1-d71a5d12dc0f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.932894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 694/1399] 10.222.0.25 () {54 vars in 943 bytes} [Mon Aug 8 02:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:25:15.938876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462618d-d494-46ac-9e7e-ca49fd5c96a3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.939157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462618d-d494-46ac-9e7e-ca49fd5c96a3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.939435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462618d-d494-46ac-9e7e-ca49fd5c96a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.964819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 706/1400] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:15.998804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:16.010560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:16.011809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:16.020605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d462618d-d494-46ac-9e7e-ca49fd5c96a3 None None] MFA Rules not processed for user `4a07806d34b143f186cfc63ea192d6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:16.021964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d462618d-d494-46ac-9e7e-ca49fd5c96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:16.088737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:16.131723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4be95-c5fd-40a9-a9d1-ff0896c9c311 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:16.135614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 695/1401] 10.222.0.25 () {58 vars in 1040 bytes} [Mon Aug 8 02:25:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:16.145114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462618d-d494-46ac-9e7e-ca49fd5c96a3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:16.155427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462618d-d494-46ac-9e7e-ca49fd5c96a3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:16.253347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58bb31-bdb3-411c-ab77-cefd7815551d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:16.254130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58bb31-bdb3-411c-ab77-cefd7815551d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:16.254437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58bb31-bdb3-411c-ab77-cefd7815551d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:16.254742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58bb31-bdb3-411c-ab77-cefd7815551d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:16.256379 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0b58bb31-bdb3-411c-ab77-cefd7815551d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:16.256565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:16.262570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644546d-b697-47a3-8e9a-02e4381c6d04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:16.263165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644546d-b697-47a3-8e9a-02e4381c6d04 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:16.263441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644546d-b697-47a3-8e9a-02e4381c6d04 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:16.263708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644546d-b697-47a3-8e9a-02e4381c6d04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:16.265383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b644546d-b697-47a3-8e9a-02e4381c6d04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:16.334275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:16.351967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58bb31-bdb3-411c-ab77-cefd7815551d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:16.352376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644546d-b697-47a3-8e9a-02e4381c6d04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:16.353646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58bb31-bdb3-411c-ab77-cefd7815551d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:16.354055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644546d-b697-47a3-8e9a-02e4381c6d04 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:16.362141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 696/1402] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:25:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:25:16.375038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 707/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:18.456430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01594ffd-70df-4418-8729-a5aeb4c6d3b6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:18.456995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01594ffd-70df-4418-8729-a5aeb4c6d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:18.456995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01594ffd-70df-4418-8729-a5aeb4c6d3b6 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:18.459266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 697/1404] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:18.464670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6de0f-1855-417b-9571-378417ff85f9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:18.465131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6de0f-1855-417b-9571-378417ff85f9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:18.465214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6de0f-1855-417b-9571-378417ff85f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:18.543362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-30e6de0f-1855-417b-9571-378417ff85f9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:18.544579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30e6de0f-1855-417b-9571-378417ff85f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:18.665718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 708/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:18.722727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01594ffd-70df-4418-8729-a5aeb4c6d3b6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:18.724297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-01594ffd-70df-4418-8729-a5aeb4c6d3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:18.881134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:18.894277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01594ffd-70df-4418-8729-a5aeb4c6d3b6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:19.015926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d284-c814-4ff1-be8d-6e6ecadd5b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:19.016487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d284-c814-4ff1-be8d-6e6ecadd5b34 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:19.016767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d284-c814-4ff1-be8d-6e6ecadd5b34 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:19.017037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d284-c814-4ff1-be8d-6e6ecadd5b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:19.018697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-af88d284-c814-4ff1-be8d-6e6ecadd5b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:19.118784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88d284-c814-4ff1-be8d-6e6ecadd5b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:19.120401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88d284-c814-4ff1-be8d-6e6ecadd5b34 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:19.132331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:19.145168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 698/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:21.222309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff315f-98d7-4b67-ab11-a1dfd6a3389c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.222912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff315f-98d7-4b67-ab11-a1dfd6a3389c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.222912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff315f-98d7-4b67-ab11-a1dfd6a3389c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.224456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 709/1407] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:21.229744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c853afc-9d87-46d8-84e0-76263acad7a4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.230174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c853afc-9d87-46d8-84e0-76263acad7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.230263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c853afc-9d87-46d8-84e0-76263acad7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.303286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1c853afc-9d87-46d8-84e0-76263acad7a4 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:21.304721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c853afc-9d87-46d8-84e0-76263acad7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:21.413307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 699/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:21.457692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff315f-98d7-4b67-ab11-a1dfd6a3389c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:21.459543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e9ff315f-98d7-4b67-ab11-a1dfd6a3389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:21.529929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:21.635187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff315f-98d7-4b67-ab11-a1dfd6a3389c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:21.759919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e852c9f-f8ce-49e0-9c32-1d557735cbdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:21.761984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e852c9f-f8ce-49e0-9c32-1d557735cbdb service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.762271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e852c9f-f8ce-49e0-9c32-1d557735cbdb service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.762595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e852c9f-f8ce-49e0-9c32-1d557735cbdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.764256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9e852c9f-f8ce-49e0-9c32-1d557735cbdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:21.781462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:21.870138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e852c9f-f8ce-49e0-9c32-1d557735cbdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:21.871750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e852c9f-f8ce-49e0-9c32-1d557735cbdb service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:21.890482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 710/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:31.411418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=67 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:31.888370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=39 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:38.569456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325febc9-5822-49c9-9efe-ccc283d3d06b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:38.570230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325febc9-5822-49c9-9efe-ccc283d3d06b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:38.570377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325febc9-5822-49c9-9efe-ccc283d3d06b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:38.572597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 700/1410] 10.222.0.25 () {54 vars in 918 bytes} [Mon Aug 8 02:25:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:38.581003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f912ae8-48a9-42e8-910e-b77a5766a8e9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:38.581449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f912ae8-48a9-42e8-910e-b77a5766a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:38.581610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f912ae8-48a9-42e8-910e-b77a5766a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:38.663147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9f912ae8-48a9-42e8-910e-b77a5766a8e9 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:38.664380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9f912ae8-48a9-42e8-910e-b77a5766a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:38.784158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 711/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Aug 8 02:25:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:38.800163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613512af-fa47-4c0b-aae2-4f893810a734 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:38.800501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613512af-fa47-4c0b-aae2-4f893810a734 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:38.800861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613512af-fa47-4c0b-aae2-4f893810a734 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:38.802906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 701/1412] 10.222.0.25 () {54 vars in 918 bytes} [Mon Aug 8 02:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:38.808969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390141d9-51a0-4709-a30b-5eb8ba1292e6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:38.809261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390141d9-51a0-4709-a30b-5eb8ba1292e6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:38.809567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390141d9-51a0-4709-a30b-5eb8ba1292e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:38.890158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:38.890158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-390141d9-51a0-4709-a30b-5eb8ba1292e6 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:38.891675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-390141d9-51a0-4709-a30b-5eb8ba1292e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:39.016706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 712/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Aug 8 02:25:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:41.487798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2e3eb-8447-4285-9c65-851f1b9da456 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:41.488708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2e3eb-8447-4285-9c65-851f1b9da456 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:41.488708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2e3eb-8447-4285-9c65-851f1b9da456 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:41.490907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:25:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:41.499771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13ac27-ed4c-4a5d-8f99-8e574288b55c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:41.500476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13ac27-ed4c-4a5d-8f99-8e574288b55c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:41.500628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13ac27-ed4c-4a5d-8f99-8e574288b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:41.572665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fd13ac27-ed4c-4a5d-8f99-8e574288b55c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:41.573898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fd13ac27-ed4c-4a5d-8f99-8e574288b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:41.634917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:41.687454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:41.742776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2e3eb-8447-4285-9c65-851f1b9da456 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:41.744943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-97a2e3eb-8447-4285-9c65-851f1b9da456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:41.905411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2e3eb-8447-4285-9c65-851f1b9da456 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:41.988388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:42.032398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748247e-c800-4840-9597-44e69a6c3d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:42.032922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748247e-c800-4840-9597-44e69a6c3d4d service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:42.033202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748247e-c800-4840-9597-44e69a6c3d4d service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:42.033501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748247e-c800-4840-9597-44e69a6c3d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:42.035122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a748247e-c800-4840-9597-44e69a6c3d4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:42.143320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748247e-c800-4840-9597-44e69a6c3d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:42.144927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748247e-c800-4840-9597-44e69a6c3d4d service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:42.164949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 703/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:43.056047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159505d2-f3ca-4163-86a7-b32f8a62219f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.056664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159505d2-f3ca-4163-86a7-b32f8a62219f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.056664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159505d2-f3ca-4163-86a7-b32f8a62219f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.058739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:43.064586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c4bca-d29c-4f8e-8eba-25f82b73a2bd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.065250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c4bca-d29c-4f8e-8eba-25f82b73a2bd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.065354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c4bca-d29c-4f8e-8eba-25f82b73a2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.161080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5b0c4bca-d29c-4f8e-8eba-25f82b73a2bd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:43.162336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5b0c4bca-d29c-4f8e-8eba-25f82b73a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:43.189840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:43.273764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:43.425725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159505d2-f3ca-4163-86a7-b32f8a62219f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:43.427962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-159505d2-f3ca-4163-86a7-b32f8a62219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:43.596016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159505d2-f3ca-4163-86a7-b32f8a62219f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:43.642896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:43.740288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8e413-4918-42c6-8b6d-656f440d56bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:43.740805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e413-4918-42c6-8b6d-656f440d56bf service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.741079 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e413-4918-42c6-8b6d-656f440d56bf service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.741346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e413-4918-42c6-8b6d-656f440d56bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.744457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d1e8e413-4918-42c6-8b6d-656f440d56bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:43.839035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8e413-4918-42c6-8b6d-656f440d56bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:43.840648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8e413-4918-42c6-8b6d-656f440d56bf service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:43.859187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 715/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:44.770682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0f3d7-8670-4497-bf73-0dd1573982bc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:44.770682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0f3d7-8670-4497-bf73-0dd1573982bc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:44.770682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0f3d7-8670-4497-bf73-0dd1573982bc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:44.772059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:44.777968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c35c-6773-471c-9b05-415003c350f5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:44.778414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c35c-6773-471c-9b05-415003c350f5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:44.778521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c35c-6773-471c-9b05-415003c350f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:44.836617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:44.871903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f514c35c-6773-471c-9b05-415003c350f5 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:44.873118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f514c35c-6773-471c-9b05-415003c350f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:44.981874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:45.136474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0f3d7-8670-4497-bf73-0dd1573982bc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:45.138764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-95c0f3d7-8670-4497-bf73-0dd1573982bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:45.305830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0f3d7-8670-4497-bf73-0dd1573982bc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:45.318763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:45.425258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ff8f-cdf7-4873-964b-00f4212b5c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:45.425891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ff8f-cdf7-4873-964b-00f4212b5c6f service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:45.426166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ff8f-cdf7-4873-964b-00f4212b5c6f service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:45.426431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ff8f-cdf7-4873-964b-00f4212b5c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:45.428055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4025ff8f-cdf7-4873-964b-00f4212b5c6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:45.523057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ff8f-cdf7-4873-964b-00f4212b5c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:45.524853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ff8f-cdf7-4873-964b-00f4212b5c6f service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:45.543567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 706/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:46.407524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c2de-ed73-4f0d-9ab1-e4cc9e7dedd7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:46.408446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c2de-ed73-4f0d-9ab1-e4cc9e7dedd7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:46.408446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c2de-ed73-4f0d-9ab1-e4cc9e7dedd7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:46.410680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:46.416732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec661d74-e9e3-44bd-995d-800fca44d16e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:46.417471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec661d74-e9e3-44bd-995d-800fca44d16e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:46.417627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec661d74-e9e3-44bd-995d-800fca44d16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:46.442261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:46.499361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ec661d74-e9e3-44bd-995d-800fca44d16e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:46.500570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ec661d74-e9e3-44bd-995d-800fca44d16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:46.609211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:46.772117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9c2de-ed73-4f0d-9ab1-e4cc9e7dedd7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:46.773341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3c9c2de-ed73-4f0d-9ab1-e4cc9e7dedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:46.908392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:46.945220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9c2de-ed73-4f0d-9ab1-e4cc9e7dedd7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:47.068085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f26097-37ba-4747-87d4-111d3f54cf10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:47.068648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26097-37ba-4747-87d4-111d3f54cf10 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:47.068921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26097-37ba-4747-87d4-111d3f54cf10 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:47.069190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26097-37ba-4747-87d4-111d3f54cf10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:47.071135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b5f26097-37ba-4747-87d4-111d3f54cf10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:47.277154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:47.291620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f26097-37ba-4747-87d4-111d3f54cf10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:47.293205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f26097-37ba-4747-87d4-111d3f54cf10 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:47.311368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 718/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:48.173330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564e20-f688-4187-90e6-9a3980fc3846 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:48.174300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564e20-f688-4187-90e6-9a3980fc3846 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:48.174300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564e20-f688-4187-90e6-9a3980fc3846 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:48.176422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:48.182588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab288-93bf-4453-9341-a8cd6e937462 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:48.183035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab288-93bf-4453-9341-a8cd6e937462 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:48.183617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab288-93bf-4453-9341-a8cd6e937462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:48.266632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2afab288-93bf-4453-9341-a8cd6e937462 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:48.267836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2afab288-93bf-4453-9341-a8cd6e937462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:48.373155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:48.526878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba564e20-f688-4187-90e6-9a3980fc3846 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:48.529236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ba564e20-f688-4187-90e6-9a3980fc3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:48.624419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:48.687815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba564e20-f688-4187-90e6-9a3980fc3846 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:48.815602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c5087-1ca3-4df1-9c2b-b99a19661d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:48.816141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5087-1ca3-4df1-9c2b-b99a19661d9f service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:48.816412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5087-1ca3-4df1-9c2b-b99a19661d9f service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:48.816678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5087-1ca3-4df1-9c2b-b99a19661d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:48.818297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2a8c5087-1ca3-4df1-9c2b-b99a19661d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:48.874882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:48.922987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c5087-1ca3-4df1-9c2b-b99a19661d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:48.924610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c5087-1ca3-4df1-9c2b-b99a19661d9f service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:48.943646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 709/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:49.748505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9e364-17e4-4265-9800-b2ca9e8473be None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:49.749080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9e364-17e4-4265-9800-b2ca9e8473be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:49.749468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9e364-17e4-4265-9800-b2ca9e8473be None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:49.751436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:49.756605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155718-f0ba-4e51-bcef-f7474efc9d00 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:49.757056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155718-f0ba-4e51-bcef-f7474efc9d00 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:49.757159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155718-f0ba-4e51-bcef-f7474efc9d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:49.838350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e3155718-f0ba-4e51-bcef-f7474efc9d00 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:49.839565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e3155718-f0ba-4e51-bcef-f7474efc9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:49.947746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:50.102011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9e364-17e4-4265-9800-b2ca9e8473be None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:50.104879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e6b9e364-17e4-4265-9800-b2ca9e8473be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:50.161980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:50.262816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9e364-17e4-4265-9800-b2ca9e8473be None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:50.381540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a6bdf-99e5-4e7a-9a38-8a6e5cb9e507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:50.382436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6bdf-99e5-4e7a-9a38-8a6e5cb9e507 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:50.382854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6bdf-99e5-4e7a-9a38-8a6e5cb9e507 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:50.383306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6bdf-99e5-4e7a-9a38-8a6e5cb9e507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:50.384994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cf3a6bdf-99e5-4e7a-9a38-8a6e5cb9e507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:50.391921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:50.474599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a6bdf-99e5-4e7a-9a38-8a6e5cb9e507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:50.476219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a6bdf-99e5-4e7a-9a38-8a6e5cb9e507 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:50.496473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 721/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:51.319784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d43825-08b4-456a-ab67-df0ac8eaed54 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:51.320453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d43825-08b4-456a-ab67-df0ac8eaed54 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:51.320453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d43825-08b4-456a-ab67-df0ac8eaed54 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:51.322153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:51.328177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b0fb-0a58-4de6-b308-197a915173d6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:51.328639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b0fb-0a58-4de6-b308-197a915173d6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:51.328752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b0fb-0a58-4de6-b308-197a915173d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:51.410184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a0f9b0fb-0a58-4de6-b308-197a915173d6 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:51.411389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0f9b0fb-0a58-4de6-b308-197a915173d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:51.484341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:51.514270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:51.674135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d43825-08b4-456a-ab67-df0ac8eaed54 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:51.675669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-12d43825-08b4-456a-ab67-df0ac8eaed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:51.695272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:51.833227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d43825-08b4-456a-ab67-df0ac8eaed54 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:51.925962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:51.953744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5003973-e50a-4fae-9f94-24f37cfd3e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:51.954360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003973-e50a-4fae-9f94-24f37cfd3e5e service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:51.954642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003973-e50a-4fae-9f94-24f37cfd3e5e service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:51.954913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003973-e50a-4fae-9f94-24f37cfd3e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:51.956528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a5003973-e50a-4fae-9f94-24f37cfd3e5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:52.051167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5003973-e50a-4fae-9f94-24f37cfd3e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:52.052782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5003973-e50a-4fae-9f94-24f37cfd3e5e service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:52.072826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 712/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:52.893161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2abf0-cc5d-4b99-a93a-e10981581a97 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:52.893739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2abf0-cc5d-4b99-a93a-e10981581a97 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:52.893739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2abf0-cc5d-4b99-a93a-e10981581a97 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:52.895707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:52.901078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93492f-a562-47c1-a35d-069b40b9cd49 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:52.901523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93492f-a562-47c1-a35d-069b40b9cd49 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:52.901627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93492f-a562-47c1-a35d-069b40b9cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:52.981139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ff93492f-a562-47c1-a35d-069b40b9cd49 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:52.982403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ff93492f-a562-47c1-a35d-069b40b9cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:53.025350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:53.082315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:53.242162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2abf0-cc5d-4b99-a93a-e10981581a97 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:53.243706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d0d2abf0-cc5d-4b99-a93a-e10981581a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:53.401752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2abf0-cc5d-4b99-a93a-e10981581a97 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:53.461302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:53.529496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344769b-978f-4742-b6a4-4706ea857bac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:53.530102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344769b-978f-4742-b6a4-4706ea857bac service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:53.530377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344769b-978f-4742-b6a4-4706ea857bac service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:53.530642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344769b-978f-4742-b6a4-4706ea857bac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:53.532247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d344769b-978f-4742-b6a4-4706ea857bac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:53.627555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344769b-978f-4742-b6a4-4706ea857bac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:53.629147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344769b-978f-4742-b6a4-4706ea857bac service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:53.647207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 724/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:54.464741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf7b15-83d2-441d-ac88-f19dc0644f68 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:54.465354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf7b15-83d2-441d-ac88-f19dc0644f68 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:54.465354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf7b15-83d2-441d-ac88-f19dc0644f68 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:54.467395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:25:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:54.472672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150fd37-edb9-429f-b9dd-617e6039b7b3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:54.473144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150fd37-edb9-429f-b9dd-617e6039b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:54.473249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150fd37-edb9-429f-b9dd-617e6039b7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:54.551281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c150fd37-edb9-429f-b9dd-617e6039b7b3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:54.552468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c150fd37-edb9-429f-b9dd-617e6039b7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:54.554577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:54.653960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:54.802078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf7b15-83d2-441d-ac88-f19dc0644f68 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:54.803634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bbcf7b15-83d2-441d-ac88-f19dc0644f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:54.970367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf7b15-83d2-441d-ac88-f19dc0644f68 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:55.009730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:55.105110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10a8cb-d93a-432b-af5b-b5502866661e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:55.105682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a8cb-d93a-432b-af5b-b5502866661e service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.105962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a8cb-d93a-432b-af5b-b5502866661e service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.106230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a8cb-d93a-432b-af5b-b5502866661e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.107849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed10a8cb-d93a-432b-af5b-b5502866661e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:55.210046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10a8cb-d93a-432b-af5b-b5502866661e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:55.211666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10a8cb-d93a-432b-af5b-b5502866661e service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:55.231378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 715/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:57.145797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43a10-903f-452f-9b8f-283e8f61434a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:57.146333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43a10-903f-452f-9b8f-283e8f61434a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:57.146333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43a10-903f-452f-9b8f-283e8f61434a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:57.147735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:57.153350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbbae8-a8b3-4acc-bca8-969542c49079 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:57.153863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbbae8-a8b3-4acc-bca8-969542c49079 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:57.153960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbbae8-a8b3-4acc-bca8-969542c49079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:57.196767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:57.230632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b3bbbae8-a8b3-4acc-bca8-969542c49079 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:57.232670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b3bbbae8-a8b3-4acc-bca8-969542c49079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:57.345687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:57.393047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e43a10-903f-452f-9b8f-283e8f61434a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:57.394668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5e43a10-903f-452f-9b8f-283e8f61434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:57.500558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e43a10-903f-452f-9b8f-283e8f61434a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:57.534385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:57.579513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94ab32-72da-4095-8f94-b4fbf0b27478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:57.580118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ab32-72da-4095-8f94-b4fbf0b27478 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:57.580389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ab32-72da-4095-8f94-b4fbf0b27478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:57.580655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ab32-72da-4095-8f94-b4fbf0b27478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:57.582294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3f94ab32-72da-4095-8f94-b4fbf0b27478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:57.694273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94ab32-72da-4095-8f94-b4fbf0b27478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:57.695733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94ab32-72da-4095-8f94-b4fbf0b27478 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:57.714740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 727/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:59.849802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313889-10d4-4720-a830-387eaca5cec7 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:59.850699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313889-10d4-4720-a830-387eaca5cec7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:59.850699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313889-10d4-4720-a830-387eaca5cec7 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:59.852954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:59.859404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022c29-03b7-4c67-96a0-21b9f415e25c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:59.860142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022c29-03b7-4c67-96a0-21b9f415e25c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:59.860331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022c29-03b7-4c67-96a0-21b9f415e25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:59.949777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f1022c29-03b7-4c67-96a0-21b9f415e25c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:59.951012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f1022c29-03b7-4c67-96a0-21b9f415e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:59.964646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:00.055470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:00.103884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89313889-10d4-4720-a830-387eaca5cec7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.105806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-89313889-10d4-4720-a830-387eaca5cec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:00.219991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89313889-10d4-4720-a830-387eaca5cec7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.232539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:00.295723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406b5bf-9e0f-43cd-b8e1-989a6c098a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.296353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b5bf-9e0f-43cd-b8e1-989a6c098a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.296603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b5bf-9e0f-43cd-b8e1-989a6c098a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.296891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b5bf-9e0f-43cd-b8e1-989a6c098a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.298525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7406b5bf-9e0f-43cd-b8e1-989a6c098a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:00.422567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406b5bf-9e0f-43cd-b8e1-989a6c098a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.424011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406b5bf-9e0f-43cd-b8e1-989a6c098a6d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.442041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 718/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:02.780758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634103c-29ab-4b2e-9db8-97af8c780db4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:02.781354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634103c-29ab-4b2e-9db8-97af8c780db4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:02.781354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634103c-29ab-4b2e-9db8-97af8c780db4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:02.782739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:02.789331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a00d8-228f-44ca-bfce-58e669c857d0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:02.790161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a00d8-228f-44ca-bfce-58e669c857d0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:02.790354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a00d8-228f-44ca-bfce-58e669c857d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:02.846963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:02.866599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e94a00d8-228f-44ca-bfce-58e669c857d0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:02.867805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e94a00d8-228f-44ca-bfce-58e669c857d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:02.969947 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:03.011810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634103c-29ab-4b2e-9db8-97af8c780db4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:03.013393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d634103c-29ab-4b2e-9db8-97af8c780db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:03.123830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634103c-29ab-4b2e-9db8-97af8c780db4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.171454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:03.207907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e37a9-929b-45b3-ae33-51a37cf9a975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.208526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e37a9-929b-45b3-ae33-51a37cf9a975 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.208808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e37a9-929b-45b3-ae33-51a37cf9a975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.209081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e37a9-929b-45b3-ae33-51a37cf9a975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.210729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b57e37a9-929b-45b3-ae33-51a37cf9a975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:03.326004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e37a9-929b-45b3-ae33-51a37cf9a975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.327360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e37a9-929b-45b3-ae33-51a37cf9a975 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:03.347125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 730/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:05.473034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3df0-b170-40ea-8486-e2943a4862e0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.473666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3df0-b170-40ea-8486-e2943a4862e0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.473666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3df0-b170-40ea-8486-e2943a4862e0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.474984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:05.481004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a208-755c-49f4-b5f5-eb9355f8cefd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.481488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a208-755c-49f4-b5f5-eb9355f8cefd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.481601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a208-755c-49f4-b5f5-eb9355f8cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.551802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6160a208-755c-49f4-b5f5-eb9355f8cefd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:05.553025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6160a208-755c-49f4-b5f5-eb9355f8cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.575790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:05.654431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:05.697866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd3df0-b170-40ea-8486-e2943a4862e0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.700543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5fcd3df0-b170-40ea-8486-e2943a4862e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.815801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd3df0-b170-40ea-8486-e2943a4862e0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.836755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:05.907866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989912a3-a393-4e80-9357-c480f58539d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.908479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989912a3-a393-4e80-9357-c480f58539d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.908754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989912a3-a393-4e80-9357-c480f58539d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.909026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989912a3-a393-4e80-9357-c480f58539d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.910685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-989912a3-a393-4e80-9357-c480f58539d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:06.034579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989912a3-a393-4e80-9357-c480f58539d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.036016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989912a3-a393-4e80-9357-c480f58539d4 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.054109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 721/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:08.228573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be408ba5-9685-4ee1-88bd-4da25ce22dd8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:08.229173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be408ba5-9685-4ee1-88bd-4da25ce22dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:08.229173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be408ba5-9685-4ee1-88bd-4da25ce22dd8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:08.230560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:08.236152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743afbb1-c483-4ac9-bce6-d73f99b7a323 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:08.236583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743afbb1-c483-4ac9-bce6-d73f99b7a323 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:08.236699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743afbb1-c483-4ac9-bce6-d73f99b7a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:08.302519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:08.305532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-743afbb1-c483-4ac9-bce6-d73f99b7a323 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:08.307456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-743afbb1-c483-4ac9-bce6-d73f99b7a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:08.423089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:08.464054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be408ba5-9685-4ee1-88bd-4da25ce22dd8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:08.465617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-be408ba5-9685-4ee1-88bd-4da25ce22dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:08.576840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be408ba5-9685-4ee1-88bd-4da25ce22dd8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:08.627558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:08.652938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0782c6-75ee-43dd-9a1f-f830a81df4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:08.653591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0782c6-75ee-43dd-9a1f-f830a81df4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:08.653867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0782c6-75ee-43dd-9a1f-f830a81df4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:08.654132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0782c6-75ee-43dd-9a1f-f830a81df4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:08.655715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bb0782c6-75ee-43dd-9a1f-f830a81df4ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:08.779347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0782c6-75ee-43dd-9a1f-f830a81df4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:08.780813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0782c6-75ee-43dd-9a1f-f830a81df4ab service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:08.800092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 733/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:10.845479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d4c85-fc29-41bb-8d4c-7b0859a25c03 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:10.846003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d4c85-fc29-41bb-8d4c-7b0859a25c03 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:10.846003 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d4c85-fc29-41bb-8d4c-7b0859a25c03 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:10.847288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:10.853881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28e17c-12f6-48eb-9d88-f11a3968dcd2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:10.854349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28e17c-12f6-48eb-9d88-f11a3968dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:10.854446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28e17c-12f6-48eb-9d88-f11a3968dcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:10.931681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ab28e17c-12f6-48eb-9d88-f11a3968dcd2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:10.932881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ab28e17c-12f6-48eb-9d88-f11a3968dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:10.962807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:11.038199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:11.077299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d4c85-fc29-41bb-8d4c-7b0859a25c03 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:11.078878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b10d4c85-fc29-41bb-8d4c-7b0859a25c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:11.193129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d4c85-fc29-41bb-8d4c-7b0859a25c03 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:11.222865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:11.272537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe065bb-0709-41fe-81a4-6d52e48a358e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:11.273436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe065bb-0709-41fe-81a4-6d52e48a358e service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:11.273793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe065bb-0709-41fe-81a4-6d52e48a358e service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:11.274219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe065bb-0709-41fe-81a4-6d52e48a358e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:11.277498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ebe065bb-0709-41fe-81a4-6d52e48a358e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:11.408542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe065bb-0709-41fe-81a4-6d52e48a358e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:11.410695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe065bb-0709-41fe-81a4-6d52e48a358e service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:11.431708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 724/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:13.473972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70a8a-c23b-4698-a3ba-6008a57a58e4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:13.474883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70a8a-c23b-4698-a3ba-6008a57a58e4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:13.474883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70a8a-c23b-4698-a3ba-6008a57a58e4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:13.477037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:13.482830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaff1c-86ee-4d81-9ede-55f7e6d96f61 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:13.483299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaff1c-86ee-4d81-9ede-55f7e6d96f61 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:13.483393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaff1c-86ee-4d81-9ede-55f7e6d96f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:13.566945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-63eaff1c-86ee-4d81-9ede-55f7e6d96f61 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:13.568800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-63eaff1c-86ee-4d81-9ede-55f7e6d96f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:13.578777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:13.669642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:13.711620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d70a8a-c23b-4698-a3ba-6008a57a58e4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:13.713101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0d70a8a-c23b-4698-a3ba-6008a57a58e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:13.833077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d70a8a-c23b-4698-a3ba-6008a57a58e4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:13.900527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:13.920734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32edcbc-f554-4160-aeca-1ada06f596db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:13.921352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32edcbc-f554-4160-aeca-1ada06f596db service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:13.921663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32edcbc-f554-4160-aeca-1ada06f596db service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:13.921964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32edcbc-f554-4160-aeca-1ada06f596db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:13.923582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e32edcbc-f554-4160-aeca-1ada06f596db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:14.038439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32edcbc-f554-4160-aeca-1ada06f596db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:14.040070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32edcbc-f554-4160-aeca-1ada06f596db service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:14.059114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 736/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:16.089263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c00a-3a3d-433f-b8aa-5bbacc3432b1 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:16.089903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c00a-3a3d-433f-b8aa-5bbacc3432b1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:16.089903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c00a-3a3d-433f-b8aa-5bbacc3432b1 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:16.091165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:16.097361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341d013-0af9-49c7-838e-92e052155991 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:16.097878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341d013-0af9-49c7-838e-92e052155991 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:16.097981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341d013-0af9-49c7-838e-92e052155991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:16.179889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9341d013-0af9-49c7-838e-92e052155991 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:16.181208 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9341d013-0af9-49c7-838e-92e052155991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:16.222611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:16.283804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:16.326415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72c00a-3a3d-433f-b8aa-5bbacc3432b1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:16.328812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-da72c00a-3a3d-433f-b8aa-5bbacc3432b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:16.438105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72c00a-3a3d-433f-b8aa-5bbacc3432b1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:16.476950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:16.515026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84225d7b-3a13-4cce-b9ae-2ca5a6ae9d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:16.515638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225d7b-3a13-4cce-b9ae-2ca5a6ae9d9d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:16.515918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225d7b-3a13-4cce-b9ae-2ca5a6ae9d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:16.516197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225d7b-3a13-4cce-b9ae-2ca5a6ae9d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:16.517825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84225d7b-3a13-4cce-b9ae-2ca5a6ae9d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:16.638135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84225d7b-3a13-4cce-b9ae-2ca5a6ae9d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:16.639599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84225d7b-3a13-4cce-b9ae-2ca5a6ae9d9d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:16.659400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 727/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:18.690616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ec1bc-9af0-4e35-9078-39214409e49a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.691184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ec1bc-9af0-4e35-9078-39214409e49a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.691184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ec1bc-9af0-4e35-9078-39214409e49a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.692514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:18.699538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7465f-36f7-4602-a204-76f253bc4d68 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.699959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7465f-36f7-4602-a204-76f253bc4d68 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.700101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7465f-36f7-4602-a204-76f253bc4d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.773188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8aa7465f-36f7-4602-a204-76f253bc4d68 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:18.774460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8aa7465f-36f7-4602-a204-76f253bc4d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:18.793250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:18.882584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:18.924780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ec1bc-9af0-4e35-9078-39214409e49a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:18.926368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d83ec1bc-9af0-4e35-9078-39214409e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:19.044233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ec1bc-9af0-4e35-9078-39214409e49a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:19.120248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:19.127988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace77c48-ac3e-4382-901a-3c393c2ccf83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:19.128606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77c48-ac3e-4382-901a-3c393c2ccf83 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:19.128876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77c48-ac3e-4382-901a-3c393c2ccf83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:19.129142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77c48-ac3e-4382-901a-3c393c2ccf83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:19.130759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ace77c48-ac3e-4382-901a-3c393c2ccf83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:19.254468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace77c48-ac3e-4382-901a-3c393c2ccf83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:19.255915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace77c48-ac3e-4382-901a-3c393c2ccf83 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:19.275508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 739/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:21.296341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78ec7-05ae-4be5-b599-8cb22b24d503 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:21.297012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78ec7-05ae-4be5-b599-8cb22b24d503 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:21.297012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78ec7-05ae-4be5-b599-8cb22b24d503 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:21.298930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:21.307922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e013-c9b6-42e9-91f4-befdf754b19b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:21.308695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e013-c9b6-42e9-91f4-befdf754b19b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:21.308871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e013-c9b6-42e9-91f4-befdf754b19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:21.385618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8bf2e013-c9b6-42e9-91f4-befdf754b19b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:21.387074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8bf2e013-c9b6-42e9-91f4-befdf754b19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:21.440510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:21.494902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:21.534887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78ec7-05ae-4be5-b599-8cb22b24d503 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:21.537238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1af78ec7-05ae-4be5-b599-8cb22b24d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:21.659960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78ec7-05ae-4be5-b599-8cb22b24d503 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:21.710710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:21.738801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e086-47e2-4d95-aa3e-47f1bd98bf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:21.739411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e086-47e2-4d95-aa3e-47f1bd98bf95 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:21.739684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e086-47e2-4d95-aa3e-47f1bd98bf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:21.739953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e086-47e2-4d95-aa3e-47f1bd98bf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:21.741580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8288e086-47e2-4d95-aa3e-47f1bd98bf95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:21.861846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e086-47e2-4d95-aa3e-47f1bd98bf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:21.863313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e086-47e2-4d95-aa3e-47f1bd98bf95 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:21.882159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 730/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:31.492726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=22 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:31.879866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=66 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:41.410362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b7038-d87c-418f-bc47-8500aba0af71 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:41.410981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b7038-d87c-418f-bc47-8500aba0af71 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:41.410981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b7038-d87c-418f-bc47-8500aba0af71 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:41.412269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 741/1471] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:41.419284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035e07-dbc1-4cd5-8d87-8e4198c27923 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:41.420044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035e07-dbc1-4cd5-8d87-8e4198c27923 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:41.420189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035e07-dbc1-4cd5-8d87-8e4198c27923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:41.502009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d5035e07-dbc1-4cd5-8d87-8e4198c27923 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:41.503212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d5035e07-dbc1-4cd5-8d87-8e4198c27923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:41.609330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 731/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:41.697214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141f9f-1f46-494e-a04b-a20a4e2fca94 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:41.697530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141f9f-1f46-494e-a04b-a20a4e2fca94 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:41.697802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141f9f-1f46-494e-a04b-a20a4e2fca94 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:41.699167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 742/1473] 10.222.0.25 () {54 vars in 966 bytes} [Mon Aug 8 02:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:41.704083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5caf-f49a-4b74-86d6-4f3a1c591c3b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:41.704373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5caf-f49a-4b74-86d6-4f3a1c591c3b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:41.704646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5caf-f49a-4b74-86d6-4f3a1c591c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:41.789444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b67a5caf-f49a-4b74-86d6-4f3a1c591c3b None None] MFA Rules not processed for user `2d691f1a09e14fc5a1858b1ac3bdd026`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:41.790673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b67a5caf-f49a-4b74-86d6-4f3a1c591c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:41.812936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:41.871854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 732/1474] 10.222.0.25 () {58 vars in 1063 bytes} [Mon Aug 8 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:41.880073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141f9f-1f46-494e-a04b-a20a4e2fca94 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:41.882592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a141f9f-1f46-494e-a04b-a20a4e2fca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:41.996568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141f9f-1f46-494e-a04b-a20a4e2fca94 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.091750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f42c3-7986-497c-924f-c3f14d3c6d10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.092590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f42c3-7986-497c-924f-c3f14d3c6d10 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.092948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f42c3-7986-497c-924f-c3f14d3c6d10 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.093295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f42c3-7986-497c-924f-c3f14d3c6d10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.095389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-441f42c3-7986-497c-924f-c3f14d3c6d10 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:42.153612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:42.209469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f42c3-7986-497c-924f-c3f14d3c6d10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.210905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f42c3-7986-497c-924f-c3f14d3c6d10 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:42.229676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 743/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:44.317118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0072825-4da6-4f69-bec5-35c7e2939bd3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:44.318072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0072825-4da6-4f69-bec5-35c7e2939bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:44.318072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0072825-4da6-4f69-bec5-35c7e2939bd3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:44.320261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 733/1476] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:26:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:44.326703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46faa33-96fd-4e63-bc2c-face57344f20 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:44.327179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46faa33-96fd-4e63-bc2c-face57344f20 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:44.327284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46faa33-96fd-4e63-bc2c-face57344f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:44.403266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a46faa33-96fd-4e63-bc2c-face57344f20 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:44.404497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a46faa33-96fd-4e63-bc2c-face57344f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:44.505755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 744/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:44.529565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0072825-4da6-4f69-bec5-35c7e2939bd3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:44.531140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b0072825-4da6-4f69-bec5-35c7e2939bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:44.664612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0072825-4da6-4f69-bec5-35c7e2939bd3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:44.717388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:44.768435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563e0d-863d-4e27-bcab-c38d5e56ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:44.769043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563e0d-863d-4e27-bcab-c38d5e56ef20 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:44.769318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563e0d-863d-4e27-bcab-c38d5e56ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:44.769624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563e0d-863d-4e27-bcab-c38d5e56ef20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:44.770255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563e0d-863d-4e27-bcab-c38d5e56ef20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:44.771996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-eb563e0d-863d-4e27-bcab-c38d5e56ef20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:26:44.771996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:26:44.771996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:26:44.773136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563e0d-863d-4e27-bcab-c38d5e56ef20 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:44.793293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 734/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Aug 8 02:26:44 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:46.790081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dfb54-d368-43e7-b09e-bf083735a8d0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:46.790713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dfb54-d368-43e7-b09e-bf083735a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:46.790713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dfb54-d368-43e7-b09e-bf083735a8d0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:46.792075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 745/1479] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:46.798609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646f9d-392b-4884-bd23-fc836c28166d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:46.799378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646f9d-392b-4884-bd23-fc836c28166d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:46.799545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646f9d-392b-4884-bd23-fc836c28166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:46.870345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-04646f9d-392b-4884-bd23-fc836c28166d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:46.871541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-04646f9d-392b-4884-bd23-fc836c28166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:46.972943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 735/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:47.021201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dfb54-d368-43e7-b09e-bf083735a8d0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:47.023620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-710dfb54-d368-43e7-b09e-bf083735a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:47.034313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:47.180562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dfb54-d368-43e7-b09e-bf083735a8d0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:47.265009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:47.299524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5086f0-55ba-40b6-8569-a7c55c6b762a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:47.300177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5086f0-55ba-40b6-8569-a7c55c6b762a service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:47.300419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5086f0-55ba-40b6-8569-a7c55c6b762a service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:47.300706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5086f0-55ba-40b6-8569-a7c55c6b762a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:47.302377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ea5086f0-55ba-40b6-8569-a7c55c6b762a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:47.395141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5086f0-55ba-40b6-8569-a7c55c6b762a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:47.396724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5086f0-55ba-40b6-8569-a7c55c6b762a service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:47.416275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 746/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:49.589457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199789a3-96ae-4550-b1d9-619545a4b3f5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:49.590035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199789a3-96ae-4550-b1d9-619545a4b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:49.590035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199789a3-96ae-4550-b1d9-619545a4b3f5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:49.591377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 736/1482] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:49.596714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880278-9ed7-4bb2-a3c8-2ea0ec59d627 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:49.597161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880278-9ed7-4bb2-a3c8-2ea0ec59d627 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:49.597291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880278-9ed7-4bb2-a3c8-2ea0ec59d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:49.666627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d3880278-9ed7-4bb2-a3c8-2ea0ec59d627 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:49.667902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3880278-9ed7-4bb2-a3c8-2ea0ec59d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:49.715607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:49.768396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 747/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:49.807386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199789a3-96ae-4550-b1d9-619545a4b3f5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:49.808979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-199789a3-96ae-4550-b1d9-619545a4b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:49.833914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:49.917677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199789a3-96ae-4550-b1d9-619545a4b3f5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:49.993098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cbfe5-7aea-4f05-9ca3-870fcb690c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:49.993859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cbfe5-7aea-4f05-9ca3-870fcb690c26 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:49.994093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cbfe5-7aea-4f05-9ca3-870fcb690c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:49.994530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cbfe5-7aea-4f05-9ca3-870fcb690c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:49.996140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fa8cbfe5-7aea-4f05-9ca3-870fcb690c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:50.083331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:50.120087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cbfe5-7aea-4f05-9ca3-870fcb690c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:50.121564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cbfe5-7aea-4f05-9ca3-870fcb690c26 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:50.142586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 737/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:52.215712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48674f26-981b-4f26-8fa1-ffa98feab9e8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.216364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48674f26-981b-4f26-8fa1-ffa98feab9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.216364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48674f26-981b-4f26-8fa1-ffa98feab9e8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.217652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 748/1485] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:52.223133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bbbb-4905-4489-9532-a8708d75c312 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.223612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bbbb-4905-4489-9532-a8708d75c312 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.223717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bbbb-4905-4489-9532-a8708d75c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.293132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-54b4bbbb-4905-4489-9532-a8708d75c312 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:52.294402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-54b4bbbb-4905-4489-9532-a8708d75c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:52.410413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 738/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:52.461333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48674f26-981b-4f26-8fa1-ffa98feab9e8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:52.463486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-48674f26-981b-4f26-8fa1-ffa98feab9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:52.585617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48674f26-981b-4f26-8fa1-ffa98feab9e8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:52.664173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:52.666749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837104b-4a94-4629-91d9-6db056e460c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:52.667375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837104b-4a94-4629-91d9-6db056e460c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.667658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837104b-4a94-4629-91d9-6db056e460c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.667931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837104b-4a94-4629-91d9-6db056e460c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.670214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7837104b-4a94-4629-91d9-6db056e460c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:52.788801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837104b-4a94-4629-91d9-6db056e460c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:52.790276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837104b-4a94-4629-91d9-6db056e460c6 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.810739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 749/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:54.980986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92b571-9705-40a2-8449-429fb5f8eb24 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:54.981602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92b571-9705-40a2-8449-429fb5f8eb24 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:54.981602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92b571-9705-40a2-8449-429fb5f8eb24 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:54.982953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 739/1488] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:54.988461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38634e-881b-49ae-98ea-68ac3425211d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:54.988951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38634e-881b-49ae-98ea-68ac3425211d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:54.988951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38634e-881b-49ae-98ea-68ac3425211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:55.058787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8f38634e-881b-49ae-98ea-68ac3425211d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:55.059996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8f38634e-881b-49ae-98ea-68ac3425211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:55.116853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:55.164994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 750/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:55.207628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92b571-9705-40a2-8449-429fb5f8eb24 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:55.209186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5c92b571-9705-40a2-8449-429fb5f8eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:55.248026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:55.321747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92b571-9705-40a2-8449-429fb5f8eb24 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:55.412506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df94b41-f77c-4181-bc93-d6b187455e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:55.413121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94b41-f77c-4181-bc93-d6b187455e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:55.413418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94b41-f77c-4181-bc93-d6b187455e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:55.413709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94b41-f77c-4181-bc93-d6b187455e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:55.415328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3df94b41-f77c-4181-bc93-d6b187455e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:55.498125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:55.528546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df94b41-f77c-4181-bc93-d6b187455e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:55.530040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df94b41-f77c-4181-bc93-d6b187455e69 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:55.548910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 740/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:57.766571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56111675-cc04-4b3b-ad2e-1d1366b5dda0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:57.767486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56111675-cc04-4b3b-ad2e-1d1366b5dda0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:57.767486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56111675-cc04-4b3b-ad2e-1d1366b5dda0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:57.769588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 751/1491] 10.222.0.25 () {54 vars in 927 bytes} [Mon Aug 8 02:26:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:57.776044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13918-9651-4e33-a18b-69bbbd48072d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:57.776491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13918-9651-4e33-a18b-69bbbd48072d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:57.776657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13918-9651-4e33-a18b-69bbbd48072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:57.854076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-15a13918-9651-4e33-a18b-69bbbd48072d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:57.855306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-15a13918-9651-4e33-a18b-69bbbd48072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:57.968402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 741/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Aug 8 02:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:58.013524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56111675-cc04-4b3b-ad2e-1d1366b5dda0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:58.015990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-56111675-cc04-4b3b-ad2e-1d1366b5dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:58.152610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56111675-cc04-4b3b-ad2e-1d1366b5dda0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:58.241717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647df3b-3c3f-4bc5-8d81-9e89b5bbfa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:58.242244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647df3b-3c3f-4bc5-8d81-9e89b5bbfa05 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:58.242518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647df3b-3c3f-4bc5-8d81-9e89b5bbfa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:58.242784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647df3b-3c3f-4bc5-8d81-9e89b5bbfa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:58.244657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2647df3b-3c3f-4bc5-8d81-9e89b5bbfa05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:58.254130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:58.362425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647df3b-3c3f-4bc5-8d81-9e89b5bbfa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:58.364635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647df3b-3c3f-4bc5-8d81-9e89b5bbfa05 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:58.385423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 752/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:07.966150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=82 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:08.382335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=50 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:10.672075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:10.672625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:10.672625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:10.754303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:10.755514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:10.867667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 742/1494] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:10.877588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68bb97-ed6c-4a23-972c-2411eb79214c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:10.878116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68bb97-ed6c-4a23-972c-2411eb79214c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:10.878116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68bb97-ed6c-4a23-972c-2411eb79214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:10.963092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6c68bb97-ed6c-4a23-972c-2411eb79214c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:10.964323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6c68bb97-ed6c-4a23-972c-2411eb79214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:11.063994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 753/1495] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:11.069661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:11.072467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:11.088799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039cf0c-1b02-4997-9861-ce91391b7ea0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:11.154908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:11.198937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:11.199543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:11.199820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:11.200089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:11.200751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:11.201043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:11.202097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:11.202097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:28:11.202097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:28:11.202993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:11.214902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 743/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:11.223796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68bb97-ed6c-4a23-972c-2411eb79214c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:11.233450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68bb97-ed6c-4a23-972c-2411eb79214c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:11.302366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:11.341594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:11.342213 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:11.342486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:11.342762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:11.343385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:11.345138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING py.warnings [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:11.345138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: warnings.warn(msg) Aug 08 02:28:11.345138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: Aug 08 02:28:11.346395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:11.406633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 754/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:11 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:11.410921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:11.412462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:11.451115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba55de9-755a-42bf-8be0-e2b75e3101b8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:11.557240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:11.557915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:11.558192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:11.558493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:11.559159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:11.560198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:11.560198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:28:11.560198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:28:11.561412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:11.614555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 744/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:11 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:11.619391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:11.620977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:11.709258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a75e-d48d-41eb-8b47-29e9e0c6cb8f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:11.796998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:11.810452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:11.811064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:11.811340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:11.811606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:11.812252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:11.813254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING py.warnings [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:11.813254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: warnings.warn(msg) Aug 08 02:28:11.813254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: Aug 08 02:28:11.814178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:11.827339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 755/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:11.831611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:11.833190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:11.845627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a5537-f6bc-47f4-b3bd-636f1238d67a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:11.873404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:11.945147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8b1e9-ce2a-4cbd-8677-c3a8224b7a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:11.945874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b1e9-ce2a-4cbd-8677-c3a8224b7a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:11.946546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b1e9-ce2a-4cbd-8677-c3a8224b7a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:11.946813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b1e9-ce2a-4cbd-8677-c3a8224b7a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:11.947451 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8b1e9-ce2a-4cbd-8677-c3a8224b7a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:11.948479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-37e8b1e9-ce2a-4cbd-8677-c3a8224b7a9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:11.948479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:28:11.948479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:28:11.949456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8b1e9-ce2a-4cbd-8677-c3a8224b7a9c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:11.961953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 745/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:11.968898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:11.971389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:12.008721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d6bd3-e37c-449f-b65a-59f2d695ecc7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:12.106505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0b15-0408-46b5-9632-30154e48824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:12.107169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0b15-0408-46b5-9632-30154e48824a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.107444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0b15-0408-46b5-9632-30154e48824a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.107711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0b15-0408-46b5-9632-30154e48824a admin admin] PATH_INFO: `/v3/projects/d9588db850c64cd2848010d79f9a385b/users/128e24698a144688b40fbe40fe36371a/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.129758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0b15-0408-46b5-9632-30154e48824a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9588db850c64cd2848010d79f9a385b, user_id=128e24698a144688b40fbe40fe36371a, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:12.130792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING py.warnings [None req-128c0b15-0408-46b5-9632-30154e48824a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:12.130792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: warnings.warn(msg) Aug 08 02:28:12.130792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: Aug 08 02:28:12.132740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0b15-0408-46b5-9632-30154e48824a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:12.160446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 756/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:11 2022] PUT /identity/v3/projects/d9588db850c64cd2848010d79f9a385b/users/128e24698a144688b40fbe40fe36371a/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:12.172866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e1dc-0701-4c23-a828-ba3f11bdd0b0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.173140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e1dc-0701-4c23-a828-ba3f11bdd0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.173461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e1dc-0701-4c23-a828-ba3f11bdd0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.231036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6fa4e1dc-0701-4c23-a828-ba3f11bdd0b0 None None] MFA Rules not processed for user `128e24698a144688b40fbe40fe36371a`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:12.232155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6fa4e1dc-0701-4c23-a828-ba3f11bdd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:12.317494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 746/1502] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:12.331967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40175f-82a0-4d28-a9b5-731438ba8f3b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.332202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40175f-82a0-4d28-a9b5-731438ba8f3b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.332505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40175f-82a0-4d28-a9b5-731438ba8f3b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.333905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 757/1503] 10.222.0.25 () {54 vars in 964 bytes} [Mon Aug 8 02:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:28:12.340478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3dd7e-5501-4742-a4f1-e9ea52982460 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.340964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3dd7e-5501-4742-a4f1-e9ea52982460 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.341434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3dd7e-5501-4742-a4f1-e9ea52982460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.382201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:12.441857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-22c3dd7e-5501-4742-a4f1-e9ea52982460 None None] MFA Rules not processed for user `913aaeebb773479e8c4cb64bb588fa34`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:12.443794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-22c3dd7e-5501-4742-a4f1-e9ea52982460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:12.538023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 747/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Aug 8 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:12.546569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40175f-82a0-4d28-a9b5-731438ba8f3b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:12.548888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c40175f-82a0-4d28-a9b5-731438ba8f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:12.606281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:12.664191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40175f-82a0-4d28-a9b5-731438ba8f3b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:12.745473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:12.746092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.746364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.746627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.748229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:12.856954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:12.858347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:12.862047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:12.883857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 758/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:12.929300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacc92c-e477-4a84-9b80-3be6a3ddb1d2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.929797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacc92c-e477-4a84-9b80-3be6a3ddb1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.929906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacc92c-e477-4a84-9b80-3be6a3ddb1d2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:12.931160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 748/1506] 10.222.0.25 () {52 vars in 830 bytes} [Mon Aug 8 02:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:28:12.935033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:12.936265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.050429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49340-da32-42e7-a42d-5f2c3297d373 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.149150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.149692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.149991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.150262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] PATH_INFO: `/v3/users/128e24698a144688b40fbe40fe36371a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.163063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=128e24698a144688b40fbe40fe36371a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.164097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING py.warnings [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:13.164097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: warnings.warn(msg) Aug 08 02:28:13.164097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: Aug 08 02:28:13.165330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.175308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:13.243851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128e24698a144688b40fbe40fe36371a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:13.256026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128e24698a144688b40fbe40fe36371a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:13.279632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128e24698a144688b40fbe40fe36371a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:13.280096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128e24698a144688b40fbe40fe36371a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:13.280618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128e24698a144688b40fbe40fe36371a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:13.303340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 759/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:12 2022] DELETE /identity/v3/users/128e24698a144688b40fbe40fe36371a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:13.309127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.309682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.309682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.375795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:13.377034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.459130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:13.472904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 749/1508] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:13.484217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:13.485524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.588125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a11f9-29a3-4b0a-a1cb-6d399d408d4b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:13.658084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:13.687875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5fbd5-a9e5-4ed8-b657-3df11ab35ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:13.688684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fbd5-a9e5-4ed8-b657-3df11ab35ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:13.689020 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fbd5-a9e5-4ed8-b657-3df11ab35ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:13.689309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fbd5-a9e5-4ed8-b657-3df11ab35ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.691841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d9f5fbd5-a9e5-4ed8-b657-3df11ab35ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.817408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5fbd5-a9e5-4ed8-b657-3df11ab35ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.818760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5fbd5-a9e5-4ed8-b657-3df11ab35ae3 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.837910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 760/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:14.274552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:14.275811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:14.287635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784845d7-17bc-48e8-ae42-3a39dc224718 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:14.389874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:14.390508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:14.390776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:14.391055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] PATH_INFO: `/v3/projects/d9588db850c64cd2848010d79f9a385b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:14.401183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9588db850c64cd2848010d79f9a385b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:14.402200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:28:14.402200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:28:14.402200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:28:14.403401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:14.471971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9588db850c64cd2848010d79f9a385b', 'request_id': 'req-66ae1934-e183-4cb2-ae68-74a82d75a21b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:14.487373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9588db850c64cd2848010d79f9a385b', 'request_id': 'req-66ae1934-e183-4cb2-ae68-74a82d75a21b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:14.501793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9588db850c64cd2848010d79f9a385b', 'request_id': 'req-66ae1934-e183-4cb2-ae68-74a82d75a21b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:14.527527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] The token cache is being invalidate because project d9588db850c64cd2848010d79f9a385b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:14.527817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:14.528247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-66ae1934-e183-4cb2-ae68-74a82d75a21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:14.529728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 750/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:14 2022] DELETE /identity/v3/projects/d9588db850c64cd2848010d79f9a385b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:23.835330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=62 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:24.525343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:25.886469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc119-05a5-49d7-8eda-55e9e718eb48 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:25.887048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc119-05a5-49d7-8eda-55e9e718eb48 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:25.887048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc119-05a5-49d7-8eda-55e9e718eb48 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:25.888886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:25.895537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a266-e8d2-4bf2-81c0-eedf628e42fd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:25.895943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a266-e8d2-4bf2-81c0-eedf628e42fd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:25.896133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a266-e8d2-4bf2-81c0-eedf628e42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:25.982286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1dd8a266-e8d2-4bf2-81c0-eedf628e42fd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:25.983501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1dd8a266-e8d2-4bf2-81c0-eedf628e42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:26.093969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:26.251598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cc119-05a5-49d7-8eda-55e9e718eb48 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:26.254248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b60cc119-05a5-49d7-8eda-55e9e718eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:26.381773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cc119-05a5-49d7-8eda-55e9e718eb48 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:26.387518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfcc99-5d2a-4cdd-96cd-e623ff29ea7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:26.388128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfcc99-5d2a-4cdd-96cd-e623ff29ea7e service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:26.388407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfcc99-5d2a-4cdd-96cd-e623ff29ea7e service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:26.388678 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfcc99-5d2a-4cdd-96cd-e623ff29ea7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:26.401535 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfcc99-5d2a-4cdd-96cd-e623ff29ea7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:26.403748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfcc99-5d2a-4cdd-96cd-e623ff29ea7e service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:26.414976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 762/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:27.254248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c340-ddbd-41f1-a4dc-9778ea723776 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.254802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c340-ddbd-41f1-a4dc-9778ea723776 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.254802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c340-ddbd-41f1-a4dc-9778ea723776 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.256035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:27.262002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920815-200b-4dcc-87f9-34bd36f6868d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.262460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920815-200b-4dcc-87f9-34bd36f6868d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.262569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920815-200b-4dcc-87f9-34bd36f6868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.291397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-36920815-200b-4dcc-87f9-34bd36f6868d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:27.292593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-36920815-200b-4dcc-87f9-34bd36f6868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:27.301774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:27.458780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c340-ddbd-41f1-a4dc-9778ea723776 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.475092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c340-ddbd-41f1-a4dc-9778ea723776 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.481675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7e0ab-4f2d-4699-bdec-533ee16942cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.482274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e0ab-4f2d-4699-bdec-533ee16942cf service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.482553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e0ab-4f2d-4699-bdec-533ee16942cf service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.482829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e0ab-4f2d-4699-bdec-533ee16942cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.491893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7e0ab-4f2d-4699-bdec-533ee16942cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.493531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7e0ab-4f2d-4699-bdec-533ee16942cf service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.503500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 753/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:27.962290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88ccd-d5ed-4935-83b2-b1050c8de9f3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.962549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88ccd-d5ed-4935-83b2-b1050c8de9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.962817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88ccd-d5ed-4935-83b2-b1050c8de9f3 None None] PATH_INFO: `/v3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.964778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 764/1517] 10.222.0.36 () {54 vars in 925 bytes} [Mon Aug 8 02:31:27 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:27.971643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd5f4f-3e4b-4618-9e69-b02362906588 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.971931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd5f4f-3e4b-4618-9e69-b02362906588 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.972201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd5f4f-3e4b-4618-9e69-b02362906588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.034262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b7fd5f4f-3e4b-4618-9e69-b02362906588 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:28.035507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b7fd5f4f-3e4b-4618-9e69-b02362906588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.052971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:28.112231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 754/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Aug 8 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:32.005355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7ea5-91a2-4bfd-8507-134b9685b970 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.006299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7ea5-91a2-4bfd-8507-134b9685b970 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.006299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7ea5-91a2-4bfd-8507-134b9685b970 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.008479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 765/1519] 10.222.0.25 () {54 vars in 961 bytes} [Mon Aug 8 02:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:32.013799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c960-9af6-4987-8e43-d2eab84c7488 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.014237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c960-9af6-4987-8e43-d2eab84c7488 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.014338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c960-9af6-4987-8e43-d2eab84c7488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.035468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bfe4c960-9af6-4987-8e43-d2eab84c7488 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:32.036697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bfe4c960-9af6-4987-8e43-d2eab84c7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:32.045781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 755/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Aug 8 02:31:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:32.053567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df7ea5-91a2-4bfd-8507-134b9685b970 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:32.076309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df7ea5-91a2-4bfd-8507-134b9685b970 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:32.083814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565db2b-3c9d-4bc6-a9b2-b06b532f137c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:32.084464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565db2b-3c9d-4bc6-a9b2-b06b532f137c service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:32.084748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565db2b-3c9d-4bc6-a9b2-b06b532f137c service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:32.085012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565db2b-3c9d-4bc6-a9b2-b06b532f137c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:32.098441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565db2b-3c9d-4bc6-a9b2-b06b532f137c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:32.100799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565db2b-3c9d-4bc6-a9b2-b06b532f137c service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:32.114488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 766/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:38.766462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5dd7a-5fe2-4ca4-9d68-915d9da98527 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.767088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5dd7a-5fe2-4ca4-9d68-915d9da98527 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.767088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5dd7a-5fe2-4ca4-9d68-915d9da98527 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.768447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:38.774374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded09b7-0bb4-49b6-8dd0-55882b60bc10 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.775114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded09b7-0bb4-49b6-8dd0-55882b60bc10 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.775270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded09b7-0bb4-49b6-8dd0-55882b60bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.805298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6ded09b7-0bb4-49b6-8dd0-55882b60bc10 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:38.806537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6ded09b7-0bb4-49b6-8dd0-55882b60bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.816498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:38.974424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5dd7a-5fe2-4ca4-9d68-915d9da98527 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.996737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5dd7a-5fe2-4ca4-9d68-915d9da98527 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.004821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe9dc7-7144-45b9-b78c-6b73dbed9e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.005457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9dc7-7144-45b9-b78c-6b73dbed9e20 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.005741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9dc7-7144-45b9-b78c-6b73dbed9e20 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.006016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9dc7-7144-45b9-b78c-6b73dbed9e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.014663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe9dc7-7144-45b9-b78c-6b73dbed9e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.016276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe9dc7-7144-45b9-b78c-6b73dbed9e20 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.026158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 757/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:39.842220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6f26-d15c-40eb-b2e5-8a66a0b12aec None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.842991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6f26-d15c-40eb-b2e5-8a66a0b12aec None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.842991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6f26-d15c-40eb-b2e5-8a66a0b12aec None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.844920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:31:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:39.850986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565037b3-5f8e-474d-82b9-66c7ad378e0d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.851414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565037b3-5f8e-474d-82b9-66c7ad378e0d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.851534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565037b3-5f8e-474d-82b9-66c7ad378e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.873176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-565037b3-5f8e-474d-82b9-66c7ad378e0d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:39.874424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-565037b3-5f8e-474d-82b9-66c7ad378e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.887483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:40.037789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6f26-d15c-40eb-b2e5-8a66a0b12aec None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.057817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6f26-d15c-40eb-b2e5-8a66a0b12aec None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.064070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bacae-50a8-423c-b940-d7351ec19733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.064682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bacae-50a8-423c-b940-d7351ec19733 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.064963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bacae-50a8-423c-b940-d7351ec19733 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.065336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bacae-50a8-423c-b940-d7351ec19733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.074830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bacae-50a8-423c-b940-d7351ec19733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.076414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bacae-50a8-423c-b940-d7351ec19733 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.086414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 769/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:43.828427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0267-de47-42b4-a5ed-0948800dc9a0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.829340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0267-de47-42b4-a5ed-0948800dc9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.829340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0267-de47-42b4-a5ed-0948800dc9a0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.831465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:31:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:43.837739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353d519-0ded-4884-abe2-9755447d554a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.838213 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353d519-0ded-4884-abe2-9755447d554a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.838320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353d519-0ded-4884-abe2-9755447d554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.867448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6353d519-0ded-4884-abe2-9755447d554a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:43.868666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6353d519-0ded-4884-abe2-9755447d554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.877751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:43.951760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f0267-de47-42b4-a5ed-0948800dc9a0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.954052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cb1f0267-de47-42b4-a5ed-0948800dc9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:44.037232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f0267-de47-42b4-a5ed-0948800dc9a0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.041230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315aaad-fe6c-4233-8a7f-58cb45643b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.041870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315aaad-fe6c-4233-8a7f-58cb45643b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.042155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315aaad-fe6c-4233-8a7f-58cb45643b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.042431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315aaad-fe6c-4233-8a7f-58cb45643b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.051781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315aaad-fe6c-4233-8a7f-58cb45643b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.053241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315aaad-fe6c-4233-8a7f-58cb45643b08 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.062527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 760/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:46.032083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771106-de49-45ab-a362-bd4deb410872 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.033039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771106-de49-45ab-a362-bd4deb410872 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.033039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771106-de49-45ab-a362-bd4deb410872 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.034687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:31:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:31:46.040807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267821ba-10ae-4eb5-bc70-a5429e3ebfc7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.041263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267821ba-10ae-4eb5-bc70-a5429e3ebfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.041397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267821ba-10ae-4eb5-bc70-a5429e3ebfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.064925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-267821ba-10ae-4eb5-bc70-a5429e3ebfc7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:46.066161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-267821ba-10ae-4eb5-bc70-a5429e3ebfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:46.075442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:46.111891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771106-de49-45ab-a362-bd4deb410872 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:46.124927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771106-de49-45ab-a362-bd4deb410872 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:46.128741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d053ee9-644e-4add-97ab-d3fb2213f64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:46.129348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053ee9-644e-4add-97ab-d3fb2213f64c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:46.129718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053ee9-644e-4add-97ab-d3fb2213f64c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:46.130063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053ee9-644e-4add-97ab-d3fb2213f64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:46.143431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d053ee9-644e-4add-97ab-d3fb2213f64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:46.144847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d053ee9-644e-4add-97ab-d3fb2213f64c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:46.155140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 772/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:49.717821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a122098-7a2a-4b3f-9075-720d95982699 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.718720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a122098-7a2a-4b3f-9075-720d95982699 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.718720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a122098-7a2a-4b3f-9075-720d95982699 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.721128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:31:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:49.727456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463ab4-92ee-447f-8487-89d025e1cd1b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:49.727928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463ab4-92ee-447f-8487-89d025e1cd1b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:49.728054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463ab4-92ee-447f-8487-89d025e1cd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:49.758442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-42463ab4-92ee-447f-8487-89d025e1cd1b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:49.759643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42463ab4-92ee-447f-8487-89d025e1cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:49.769041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:50.074302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a122098-7a2a-4b3f-9075-720d95982699 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:50.076372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0a122098-7a2a-4b3f-9075-720d95982699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:50.153878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:50.169029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a122098-7a2a-4b3f-9075-720d95982699 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:50.173167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c8b53-387a-475c-b05c-f4db31bcad69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:50.173818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c8b53-387a-475c-b05c-f4db31bcad69 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:50.174149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c8b53-387a-475c-b05c-f4db31bcad69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:50.174424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c8b53-387a-475c-b05c-f4db31bcad69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:50.183895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c8b53-387a-475c-b05c-f4db31bcad69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:50.185508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c8b53-387a-475c-b05c-f4db31bcad69 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:50.195510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 763/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:52.209073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5454b-ab5c-44a3-b0ca-45787a45e4ef None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:52.209998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5454b-ab5c-44a3-b0ca-45787a45e4ef None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:52.210095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5454b-ab5c-44a3-b0ca-45787a45e4ef None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:52.212324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:31:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:31:52.218576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679b60e-edff-4000-9207-3dfb18205067 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:52.219031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679b60e-edff-4000-9207-3dfb18205067 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:52.219129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679b60e-edff-4000-9207-3dfb18205067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:52.246125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9679b60e-edff-4000-9207-3dfb18205067 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:52.247326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9679b60e-edff-4000-9207-3dfb18205067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:52.256523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:52.562177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5454b-ab5c-44a3-b0ca-45787a45e4ef None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:52.565491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-99e5454b-ab5c-44a3-b0ca-45787a45e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:52.581198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5454b-ab5c-44a3-b0ca-45787a45e4ef None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:52.585728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf0781-6380-44d6-8074-16eadbc7525a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:52.586337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0781-6380-44d6-8074-16eadbc7525a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:52.586619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0781-6380-44d6-8074-16eadbc7525a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:52.586891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0781-6380-44d6-8074-16eadbc7525a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:52.596412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf0781-6380-44d6-8074-16eadbc7525a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:52.597883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf0781-6380-44d6-8074-16eadbc7525a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:52.607363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 775/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:02.240889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=11 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:02.603281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:17.615163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db364a0-65e5-4bc0-9fa1-b42a8c30edd1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.616374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db364a0-65e5-4bc0-9fa1-b42a8c30edd1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.616874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db364a0-65e5-4bc0-9fa1-b42a8c30edd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.647056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3db364a0-65e5-4bc0-9fa1-b42a8c30edd1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.648748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3db364a0-65e5-4bc0-9fa1-b42a8c30edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.666004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 765/1540] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:17.675235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b868-446c-4393-b2bb-f784e77d706b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.676376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b868-446c-4393-b2bb-f784e77d706b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.676868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b868-446c-4393-b2bb-f784e77d706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.703763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f327955-60af-42d9-81b4-f5a5e0c45b06 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.704234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bed0b868-446c-4393-b2bb-f784e77d706b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.704684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f327955-60af-42d9-81b4-f5a5e0c45b06 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.705182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f327955-60af-42d9-81b4-f5a5e0c45b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.705515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bed0b868-446c-4393-b2bb-f784e77d706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.718439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 776/1541] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:17.723378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b868-446c-4393-b2bb-f784e77d706b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:17.734395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4f327955-60af-42d9-81b4-f5a5e0c45b06 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.735894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4f327955-60af-42d9-81b4-f5a5e0c45b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.738773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b868-446c-4393-b2bb-f784e77d706b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:17.743868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:17.744506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.744790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.745065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.746033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:17.746352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:17.747575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING py.warnings [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:33:17.747575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: warnings.warn(msg) Aug 08 02:33:17.747575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: Aug 08 02:33:17.749282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bc521-f491-4373-92ef-1447f963f2d9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:17.755431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 766/1542] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:17.757182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36c04-9302-4d9d-b8b6-774134979cd5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.757182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36c04-9302-4d9d-b8b6-774134979cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.757421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36c04-9302-4d9d-b8b6-774134979cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.767358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 777/1543] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:33:17.769091 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf100e0-ef7f-4464-87ce-a216ebd9b3cc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.769591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf100e0-ef7f-4464-87ce-a216ebd9b3cc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.770040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf100e0-ef7f-4464-87ce-a216ebd9b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.794199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ecf100e0-ef7f-4464-87ce-a216ebd9b3cc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.795716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ecf100e0-ef7f-4464-87ce-a216ebd9b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.796394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f2a36c04-9302-4d9d-b8b6-774134979cd5 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.797694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f2a36c04-9302-4d9d-b8b6-774134979cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.811226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 767/1544] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:17.812746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 778/1545] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:17.814215 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41084a-b73b-4dde-b69d-75bfc2e46b1b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.815183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf100e0-ef7f-4464-87ce-a216ebd9b3cc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:17.820660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41084a-b73b-4dde-b69d-75bfc2e46b1b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.821187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41084a-b73b-4dde-b69d-75bfc2e46b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.838021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf100e0-ef7f-4464-87ce-a216ebd9b3cc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:17.854090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2ff53-8bbb-42e3-8315-20e851c89a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:17.855014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ff53-8bbb-42e3-8315-20e851c89a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.855470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ff53-8bbb-42e3-8315-20e851c89a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.855903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ff53-8bbb-42e3-8315-20e851c89a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.856820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2ff53-8bbb-42e3-8315-20e851c89a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:17.859800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2ff53-8bbb-42e3-8315-20e851c89a70 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:17.866791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3b41084a-b73b-4dde-b69d-75bfc2e46b1b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.868599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3b41084a-b73b-4dde-b69d-75bfc2e46b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.876824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 768/1546] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:17.878352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b769-a052-4104-9abb-26ba278c411b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.878806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b769-a052-4104-9abb-26ba278c411b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.879100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b769-a052-4104-9abb-26ba278c411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.905958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d5b2b769-a052-4104-9abb-26ba278c411b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.907204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d5b2b769-a052-4104-9abb-26ba278c411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.918500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 769/1547] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:17.918697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 779/1548] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:17.918787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c26378-3c21-4819-8718-931999589152 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.918787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c26378-3c21-4819-8718-931999589152 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.918787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c26378-3c21-4819-8718-931999589152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.921349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820592-1591-4d5f-a52c-69079e2babf2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:17.921660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820592-1591-4d5f-a52c-69079e2babf2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:17.921936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820592-1591-4d5f-a52c-69079e2babf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:17.949854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-58820592-1591-4d5f-a52c-69079e2babf2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.950334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-45c26378-3c21-4819-8718-931999589152 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:17.951175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-58820592-1591-4d5f-a52c-69079e2babf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:17.951579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45c26378-3c21-4819-8718-931999589152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.009571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 780/1549] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.010430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 770/1550] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.010822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093cdd-4266-4858-9ea8-5a513ac31bdf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.011103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093cdd-4266-4858-9ea8-5a513ac31bdf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.011293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c26378-3c21-4819-8718-931999589152 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.011412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093cdd-4266-4858-9ea8-5a513ac31bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.026063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c26378-3c21-4819-8718-931999589152 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.030702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.031026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-34093cdd-4266-4858-9ea8-5a513ac31bdf None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.031364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.031648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.031924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.032209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-34093cdd-4266-4858-9ea8-5a513ac31bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.032580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:18.032887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.034537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.040222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 781/1551] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.041438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36346328-e5f3-488a-b3c7-446777e595f0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.041720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36346328-e5f3-488a-b3c7-446777e595f0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.041988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36346328-e5f3-488a-b3c7-446777e595f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.050596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 771/1552] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:18.051411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.061111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e719-fa50-43d1-800d-e9dfc71a0b2c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.061674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-36346328-e5f3-488a-b3c7-446777e595f0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.062866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-36346328-e5f3-488a-b3c7-446777e595f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.066318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0f208-3681-4e64-8712-8f7bf7adde49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.066923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f208-3681-4e64-8712-8f7bf7adde49 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.067204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f208-3681-4e64-8712-8f7bf7adde49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.067480 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f208-3681-4e64-8712-8f7bf7adde49 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.068436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0f208-3681-4e64-8712-8f7bf7adde49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.070479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0f208-3681-4e64-8712-8f7bf7adde49 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.071807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 782/1553] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.072579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36346328-e5f3-488a-b3c7-446777e595f0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.088710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36346328-e5f3-488a-b3c7-446777e595f0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.093750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd423ed8-c1b0-4f0d-a04d-8cf8b2995703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.094359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd423ed8-c1b0-4f0d-a04d-8cf8b2995703 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.094634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd423ed8-c1b0-4f0d-a04d-8cf8b2995703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.094897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd423ed8-c1b0-4f0d-a04d-8cf8b2995703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.095239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 772/1554] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.095540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd423ed8-c1b0-4f0d-a04d-8cf8b2995703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:18.095838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd423ed8-c1b0-4f0d-a04d-8cf8b2995703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.096473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af915ff-6e1d-4750-b472-d3e3251685af None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.096755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af915ff-6e1d-4750-b472-d3e3251685af None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.097026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af915ff-6e1d-4750-b472-d3e3251685af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.097467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd423ed8-c1b0-4f0d-a04d-8cf8b2995703 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.110517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 783/1555] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:18.112219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75e23d-2753-4d2f-96fd-8d56ce46caf0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.112508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75e23d-2753-4d2f-96fd-8d56ce46caf0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.112777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75e23d-2753-4d2f-96fd-8d56ce46caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.117158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9af915ff-6e1d-4750-b472-d3e3251685af None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.118712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9af915ff-6e1d-4750-b472-d3e3251685af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.127209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 773/1556] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.127702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af915ff-6e1d-4750-b472-d3e3251685af None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.132588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1d75e23d-2753-4d2f-96fd-8d56ce46caf0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.134677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1d75e23d-2753-4d2f-96fd-8d56ce46caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.137436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af915ff-6e1d-4750-b472-d3e3251685af None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.142020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.142617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.142896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.143003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 784/1557] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.143167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.143822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:18.144133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.144272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdbf41-b6a9-484c-9c76-b8ed75173462 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.144549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdbf41-b6a9-484c-9c76-b8ed75173462 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.144831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdbf41-b6a9-484c-9c76-b8ed75173462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.145767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.158558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 774/1558] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:18.159302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.164827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c7fdbf41-b6a9-484c-9c76-b8ed75173462 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.166228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7fdbf41-b6a9-484c-9c76-b8ed75173462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.170217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9040285-42dc-4f03-ba23-946b57e37bb8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.174174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 785/1559] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.177911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.178023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a4a8-213d-4015-b609-27ad32d857ec None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.178110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.178195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a4a8-213d-4015-b609-27ad32d857ec None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.178276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.178356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a4a8-213d-4015-b609-27ad32d857ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.178429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.178429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.178429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:33:18.178429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:33:18.178429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:33:18.179001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.195384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0717a4a8-213d-4015-b609-27ad32d857ec None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.196685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0717a4a8-213d-4015-b609-27ad32d857ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.206562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 786/1560] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.207635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a4a8-213d-4015-b609-27ad32d857ec None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.212071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 775/1561] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.212071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.218167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a4a8-213d-4015-b609-27ad32d857ec None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.268264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:18.271445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:18.276008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd21e-2358-4490-bb42-1bd47c0955d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.276702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd21e-2358-4490-bb42-1bd47c0955d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.276844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaea84-8542-47dc-8264-217c96c205f5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.276969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd21e-2358-4490-bb42-1bd47c0955d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.277412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd21e-2358-4490-bb42-1bd47c0955d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.278202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd21e-2358-4490-bb42-1bd47c0955d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.279968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd21e-2358-4490-bb42-1bd47c0955d8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.283543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.284156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.284432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.284701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.285327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.287444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.293733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 787/1562] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:18.293733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e849a-bcf1-491f-8bbf-a77b68a4fc70 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.293733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e849a-bcf1-491f-8bbf-a77b68a4fc70 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.293733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e849a-bcf1-491f-8bbf-a77b68a4fc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.312177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-506e849a-bcf1-491f-8bbf-a77b68a4fc70 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:18.313418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-506e849a-bcf1-491f-8bbf-a77b68a4fc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.317158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 776/1563] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.317988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.321662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 788/1564] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:18.321662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e849a-bcf1-491f-8bbf-a77b68a4fc70 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.331682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e849a-bcf1-491f-8bbf-a77b68a4fc70 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.379387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de09f9d-f26f-4c2e-a023-8357dcd1ecc9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.384058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.384675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.384949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.385221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.385907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:18.386201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.386821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.387439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.387720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.387923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.388031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.388610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.390573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.399401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 777/1565] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:18.400290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.411965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b47477-3211-4569-a604-04d40da45b43 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.417142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.417773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.418067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.418335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.418954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:18.419254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.420854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.425982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 789/1566] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.425982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.433185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 778/1567] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:18.434284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.445841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17246c53-328d-4487-a7ff-028359bedd38 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.491104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9feea-76ed-4d6f-9437-7a78368a5655 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.495921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.496637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.497148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.497276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.497843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:18.498143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.499776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.503090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.503691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.503967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.504234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.504855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.506824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.511241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 790/1568] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:18.512132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.525596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79271-4168-4657-a635-f09e00e57c9f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.530698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.531305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.531485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 779/1569] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.531608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.531869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.532507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.534143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.535261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.547878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 791/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:18.547878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.548169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea0b4-0441-451c-8c64-030b3361be75 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.551877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.552488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.552770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.553044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.553706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.554857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b41ae-8d1d-4dd8-9433-9af9926e5b6e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.556430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.559539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.560119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.560395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.560663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.561291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:18.561612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.563189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.576512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 792/1571] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:18.577313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.580233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 780/1572] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/users => generated 284 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.581219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.593816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad599-9e7c-426a-9f11-27fb7ea17739 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.594021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ca322-8428-487e-8298-20ff2c29f895 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.598307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.598905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.599030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.599178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.599447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.599589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.599851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.600090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.600233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.600718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.602006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.602711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.628915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 781/1573] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.629822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.635568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 793/1574] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.636451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.642554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3fec-5f73-413c-bc86-9674c5148a56 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.654233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:18.658225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:18.703519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.704136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.704421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.704690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.705340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.706455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad6bf-d375-46c8-97ad-b0548b97d69c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.707305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.711216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.711928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.712326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.712603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.713233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.715205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.736730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 782/1575] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.737706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.746744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 794/1576] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.746744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.800810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a9830-a101-40f6-916a-67748d4b778f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.807014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.807629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.807908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.808013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252c41-140d-4e29-8e31-7c3e9ef2d400 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.808185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.808834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.810577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.812440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.813095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.813397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.813679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] PATH_INFO: `/v3/projects/9947d40ca2d1401797f9a236038d7ad6/users/154d593430de4ac29acf8c1c1f4ce5fe/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.824172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 783/1577] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:18.824172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.831508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3bf48-390f-4b23-a8b6-560e33ac910b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.831660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9947d40ca2d1401797f9a236038d7ad6, user_id=154d593430de4ac29acf8c1c1f4ce5fe, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.834454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.836233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.836878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.837151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.837608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.838360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.840054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.849717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 795/1578] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:18 2022] PUT /identity/v3/projects/9947d40ca2d1401797f9a236038d7ad6/users/154d593430de4ac29acf8c1c1f4ce5fe/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:18.853701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 784/1579] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:18.854912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.857247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.871341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34ef42-7808-4ea9-bad9-0fa5f2498847 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.928103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466aca4-a9c1-446b-bdb6-6b57da650d06 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.933031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.933681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.933797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.933962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.934234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.934342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.934691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.934864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.934964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.935602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.936775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.937260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.947808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 785/1580] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:18.948710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.958941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785305c6-8bdc-4efa-b167-6af6bc9ec0f6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.963860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.964447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.964720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.964995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.965638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.967239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 796/1581] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.967544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:18.968265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.982484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:18.989916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 786/1582] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:18.990568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.996954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.001145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bbe3-8b9e-447b-aa94-cab78c47e79a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.035064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d417d-59a6-4260-b537-5f19eba95786 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.039984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.040638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.040888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.041160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.041875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.042944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING py.warnings [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:33:19.042944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: warnings.warn(msg) Aug 08 02:33:19.042944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: Aug 08 02:33:19.044143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.058740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.059360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.059640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.060087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.060650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.062607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.069670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 797/1583] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:19.070161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.080657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbe43f-5460-4607-a800-7f981ff8b342 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.085683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5dde2-8257-437b-8495-b197089354e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.086449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5dde2-8257-437b-8495-b197089354e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.090040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 787/1584] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:18 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:19.090200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5dde2-8257-437b-8495-b197089354e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.090200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5dde2-8257-437b-8495-b197089354e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.090200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5dde2-8257-437b-8495-b197089354e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.090495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.090592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5dde2-8257-437b-8495-b197089354e6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.097934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c2eb-d758-405c-8cf4-c4bc6bafdc35 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.102009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 798/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.103398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.103999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.104278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.104552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.105293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.106331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb18b-52c2-4dd2-b4d0-dae58522874d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.106603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb18b-52c2-4dd2-b4d0-dae58522874d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.106878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb18b-52c2-4dd2-b4d0-dae58522874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.106969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.118919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 788/1586] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.119766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.129667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8850e49-0ad3-4817-b70e-6b39b8e8e183 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.134251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.134842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.135114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.135380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.136012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.136699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e2abb18b-52c2-4dd2-b4d0-dae58522874d None None] MFA Rules not processed for user `154d593430de4ac29acf8c1c1f4ce5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.137654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.138064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e2abb18b-52c2-4dd2-b4d0-dae58522874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.148345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 789/1587] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.153010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.162808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041980ed-2e3c-41dd-82e4-88ed4495e2ec admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.168697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.169267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.169577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.169848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.170459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.172348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.195673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 790/1588] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:19.196827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.205547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 799/1589] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:19.206529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb18b-52c2-4dd2-b4d0-dae58522874d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.206871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550452c3-8605-44f0-8cad-490a5d3909d2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.212750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.213975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.214261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.214536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.215186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.216787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.217991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb18b-52c2-4dd2-b4d0-dae58522874d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.222645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.223254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.223543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.223814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.224463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.226101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.228432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 791/1590] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.232481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.241269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 800/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.241269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.246622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31856-2734-4177-a2ea-743c632b7945 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.250727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afebcc7-1d3b-4ba0-b8cf-23dcedc93557 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.251930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.252634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.253031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.253306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.253972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.255579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.255778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.256440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.256720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.256999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] PATH_INFO: `/v3/projects/ac6df5008fc145cd8a3cf67e1154ca8a/users/d2194dacd30e45bd87d38b70d1b3bbdc/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.266290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 792/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.269360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.272728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6df5008fc145cd8a3cf67e1154ca8a, user_id=d2194dacd30e45bd87d38b70d1b3bbdc, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.275811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.277224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5e4f-ceea-4962-9e88-d7604c24bafd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.281889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.282669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.283026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.283290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] PATH_INFO: `/v3/projects/298b12a46ddf44cb88b39fc05a0119ff/users/871885f0bb9843b3a5b10b2adeee6dde/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.291453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 801/1593] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:19 2022] PUT /identity/v3/projects/ac6df5008fc145cd8a3cf67e1154ca8a/users/d2194dacd30e45bd87d38b70d1b3bbdc/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.292421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.301921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298b12a46ddf44cb88b39fc05a0119ff, user_id=871885f0bb9843b3a5b10b2adeee6dde, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.303047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:33:19.303047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:33:19.303047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:33:19.305226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.321625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 793/1594] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:19 2022] PUT /identity/v3/projects/298b12a46ddf44cb88b39fc05a0119ff/users/871885f0bb9843b3a5b10b2adeee6dde/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.322671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.341842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.357008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd03dd-c7fe-4d4b-b210-5de74f228076 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.389617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e62b2-25fe-48da-99ee-f117b60c0329 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.394150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.394751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.395026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.395297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.395933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.397567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.407727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 794/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.408532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.414317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.414509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.415583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.416024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.416305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] PATH_INFO: `/v3/projects/24d55693a031439badd9ac6e71655574/users/0aa7040691be4940a0059eac5d638109/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.418254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783778c-7e75-4d78-9318-b122d9ce58a1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.424304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847296c-7360-462b-a0f3-361fd36bf369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.425054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847296c-7360-462b-a0f3-361fd36bf369 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.425504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847296c-7360-462b-a0f3-361fd36bf369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.425973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847296c-7360-462b-a0f3-361fd36bf369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.426727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847296c-7360-462b-a0f3-361fd36bf369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.428476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847296c-7360-462b-a0f3-361fd36bf369 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.431265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d55693a031439badd9ac6e71655574, user_id=0aa7040691be4940a0059eac5d638109, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.433980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.438580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 795/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.439889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad788d-e5d3-4e30-a4ae-dac627218ccf None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.440170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad788d-e5d3-4e30-a4ae-dac627218ccf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.440441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad788d-e5d3-4e30-a4ae-dac627218ccf None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.441683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 796/1597] 10.222.0.25 () {54 vars in 962 bytes} [Mon Aug 8 02:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:19.442365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad788d-e5d3-4e30-a4ae-dac627218ccf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.452321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 802/1598] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:19 2022] PUT /identity/v3/projects/24d55693a031439badd9ac6e71655574/users/0aa7040691be4940a0059eac5d638109/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.453213 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.459486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad788d-e5d3-4e30-a4ae-dac627218ccf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.512621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b179b-8698-40ca-903c-fe3f2bc86329 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.515277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ff9af-bb75-42b4-b7f1-ada907744d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.515906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ff9af-bb75-42b4-b7f1-ada907744d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.516169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ff9af-bb75-42b4-b7f1-ada907744d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.516450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ff9af-bb75-42b4-b7f1-ada907744d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.517097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ff9af-bb75-42b4-b7f1-ada907744d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.517427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce810af5-ca5b-4640-a051-7d4a8ccf94ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.518186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce810af5-ca5b-4640-a051-7d4a8ccf94ac admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.518463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce810af5-ca5b-4640-a051-7d4a8ccf94ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.518733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce810af5-ca5b-4640-a051-7d4a8ccf94ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.518847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ff9af-bb75-42b4-b7f1-ada907744d0c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.519366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce810af5-ca5b-4640-a051-7d4a8ccf94ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.521022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce810af5-ca5b-4640-a051-7d4a8ccf94ac admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.528962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 797/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.531790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 803/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.533415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bf034-14a8-4b1c-860a-3065193791d0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.533713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add567-7844-416d-9807-a9dd8cbc620a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.533856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bf034-14a8-4b1c-860a-3065193791d0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.534020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bf034-14a8-4b1c-860a-3065193791d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.534128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add567-7844-416d-9807-a9dd8cbc620a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.534419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add567-7844-416d-9807-a9dd8cbc620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.553006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-713bf034-14a8-4b1c-860a-3065193791d0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.554240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-713bf034-14a8-4b1c-860a-3065193791d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.562125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 798/1601] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:19.565419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e9add567-7844-416d-9807-a9dd8cbc620a None None] MFA Rules not processed for user `871885f0bb9843b3a5b10b2adeee6dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.565547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bf034-14a8-4b1c-860a-3065193791d0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.565650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e9add567-7844-416d-9807-a9dd8cbc620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.576929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bf034-14a8-4b1c-860a-3065193791d0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.581612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.582221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.582497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.582767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.583411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.585011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.595228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 799/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:19.599405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.608737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aafd0e-8dcd-4c6b-bc02-b855c11d7837 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.613245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a67dc0-ce61-4d26-8c45-33530ac56f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.613915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67dc0-ce61-4d26-8c45-33530ac56f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.614204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67dc0-ce61-4d26-8c45-33530ac56f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.614481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67dc0-ce61-4d26-8c45-33530ac56f6c admin admin] PATH_INFO: `/v3/projects/c45e176ea4ab4bf59975895aa26ac4df/users/b75869e43eaa48458cdf5ff6f3a08447/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.631923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a67dc0-ce61-4d26-8c45-33530ac56f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45e176ea4ab4bf59975895aa26ac4df, user_id=b75869e43eaa48458cdf5ff6f3a08447, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.634819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a67dc0-ce61-4d26-8c45-33530ac56f6c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.645302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 804/1603] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:19.649454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc735-5d07-4a70-8695-85a262c07c78 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.649454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc735-5d07-4a70-8695-85a262c07c78 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.649454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc735-5d07-4a70-8695-85a262c07c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.649752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 800/1604] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:19 2022] PUT /identity/v3/projects/c45e176ea4ab4bf59975895aa26ac4df/users/b75869e43eaa48458cdf5ff6f3a08447/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.650110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db23af-82cc-4ddb-ac17-b0767d037baa None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.650389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db23af-82cc-4ddb-ac17-b0767d037baa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.650658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db23af-82cc-4ddb-ac17-b0767d037baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.658994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.670499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-62db23af-82cc-4ddb-ac17-b0767d037baa None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.671677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-62db23af-82cc-4ddb-ac17-b0767d037baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.692645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-01bdc735-5d07-4a70-8695-85a262c07c78 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.694369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-01bdc735-5d07-4a70-8695-85a262c07c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.744339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 801/1605] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:19.745238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db23af-82cc-4ddb-ac17-b0767d037baa None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.755915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db23af-82cc-4ddb-ac17-b0767d037baa None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.760933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.761632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.761916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.762193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] PATH_INFO: `/v3/projects/2b00cb60924c4a38af5f1f8c0864988b/users/0b60e69a777c45b09b53250629596411/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.771745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 805/1606] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:19.772557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdc735-5d07-4a70-8695-85a262c07c78 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.778432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b00cb60924c4a38af5f1f8c0864988b, user_id=0b60e69a777c45b09b53250629596411, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.781402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.782865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdc735-5d07-4a70-8695-85a262c07c78 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.787874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.788578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.788860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.789136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] PATH_INFO: `/v3/projects/f9f3b6d0b9e2466ab1bd7089ae1859d7/users/d1cd3355c686459f960043ad2e3a26ee/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.796274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 802/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:19 2022] PUT /identity/v3/projects/2b00cb60924c4a38af5f1f8c0864988b/users/0b60e69a777c45b09b53250629596411/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.799070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.811627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f3b6d0b9e2466ab1bd7089ae1859d7, user_id=d1cd3355c686459f960043ad2e3a26ee, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.814509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.830588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 806/1608] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:19 2022] PUT /identity/v3/projects/f9f3b6d0b9e2466ab1bd7089ae1859d7/users/d1cd3355c686459f960043ad2e3a26ee/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.831399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.840158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.868987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a983d-93a5-4cab-90c4-51241c743a74 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.903000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe51b1-2218-4558-9fec-c0f9e90d44cc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.907796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eb3d9-3641-4abb-b156-6e847ebec9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.908495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb3d9-3641-4abb-b156-6e847ebec9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.908777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb3d9-3641-4abb-b156-6e847ebec9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.909048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb3d9-3641-4abb-b156-6e847ebec9a8 admin admin] PATH_INFO: `/v3/projects/f3db5aab82444769b6069f200ac5dffa/users/d91359eb2ecb4b7391f579732a596602/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.919121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.919846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.920398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.920740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.923723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eb3d9-3641-4abb-b156-6e847ebec9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3db5aab82444769b6069f200ac5dffa, user_id=d91359eb2ecb4b7391f579732a596602, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.926439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eb3d9-3641-4abb-b156-6e847ebec9a8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.931339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.933069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.941304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 807/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:19 2022] PUT /identity/v3/projects/f3db5aab82444769b6069f200ac5dffa/users/d91359eb2ecb4b7391f579732a596602/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.942633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd8a3-08b1-4cc3-96f9-324bda429f62 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.942914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd8a3-08b1-4cc3-96f9-324bda429f62 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.943530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd8a3-08b1-4cc3-96f9-324bda429f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.947495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 803/1610] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:19.948347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.972194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-954dd8a3-08b1-4cc3-96f9-324bda429f62 None None] MFA Rules not processed for user `b75869e43eaa48458cdf5ff6f3a08447`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.974250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-954dd8a3-08b1-4cc3-96f9-324bda429f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:20.007689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:20.011768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0f98-8f87-40fb-85f3-73aec8e86611 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.050700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 808/1611] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:20.051762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd8a3-08b1-4cc3-96f9-324bda429f62 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.073332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.074241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.074766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.075141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.116317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd8a3-08b1-4cc3-96f9-324bda429f62 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.120927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac3b52-6f7c-4c35-a498-32fca90d09b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.121591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac3b52-6f7c-4c35-a498-32fca90d09b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.121877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac3b52-6f7c-4c35-a498-32fca90d09b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.122150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac3b52-6f7c-4c35-a498-32fca90d09b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.141941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:20.149923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:20.153051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:20.184410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 804/1612] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:20.185821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.241989 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac3b52-6f7c-4c35-a498-32fca90d09b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:20.244362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac3b52-6f7c-4c35-a498-32fca90d09b5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:20.258708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 809/1613] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:20.260480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2c37-90e7-4091-893f-f22d2cd5ee20 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.260912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2c37-90e7-4091-893f-f22d2cd5ee20 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.261339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2c37-90e7-4091-893f-f22d2cd5ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.284769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded20db-4756-4760-ac25-0db12acf14d1 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.292715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d3c83-7779-4994-abad-5530fce7614e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.293614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3c83-7779-4994-abad-5530fce7614e service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.294071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3c83-7779-4994-abad-5530fce7614e service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.294516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3c83-7779-4994-abad-5530fce7614e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.299698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ecfc2c37-90e7-4091-893f-f22d2cd5ee20 None None] MFA Rules not processed for user `0b60e69a777c45b09b53250629596411`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:20.301765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ecfc2c37-90e7-4091-893f-f22d2cd5ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:20.391504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d3c83-7779-4994-abad-5530fce7614e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:20.394131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d3c83-7779-4994-abad-5530fce7614e service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:20.397691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 810/1614] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:20.399280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d1b7-d1d0-4bf0-8322-998456c3ea6a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.399671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d1b7-d1d0-4bf0-8322-998456c3ea6a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.400091 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d1b7-d1d0-4bf0-8322-998456c3ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.424401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:20.425276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 805/1615] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:20.430642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd998d8-6cad-43d4-bf50-372e1c0777ef None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.431035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd998d8-6cad-43d4-bf50-372e1c0777ef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.431556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd998d8-6cad-43d4-bf50-372e1c0777ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.436747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3173d1b7-d1d0-4bf0-8322-998456c3ea6a None None] MFA Rules not processed for user `d1cd3355c686459f960043ad2e3a26ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:20.438062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3173d1b7-d1d0-4bf0-8322-998456c3ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:20.489938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3dd998d8-6cad-43d4-bf50-372e1c0777ef None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:20.491197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3dd998d8-6cad-43d4-bf50-372e1c0777ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:20.506242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 806/1616] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:20.506242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd998d8-6cad-43d4-bf50-372e1c0777ef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.515164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd998d8-6cad-43d4-bf50-372e1c0777ef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.520113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0d1ae-d7ef-441c-aa10-d2c4d121f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.521600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d1ae-d7ef-441c-aa10-d2c4d121f6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.521898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d1ae-d7ef-441c-aa10-d2c4d121f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.522158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d1ae-d7ef-441c-aa10-d2c4d121f6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.522972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0d1ae-d7ef-441c-aa10-d2c4d121f6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:20.526354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0d1ae-d7ef-441c-aa10-d2c4d121f6b9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:20.556876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 811/1617] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:20.560822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5be704-96ac-46d6-a240-dcecbbf999e6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.560822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5be704-96ac-46d6-a240-dcecbbf999e6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.560822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5be704-96ac-46d6-a240-dcecbbf999e6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.561339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 812/1618] 10.222.0.25 () {54 vars in 962 bytes} [Mon Aug 8 02:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:20.562322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5be704-96ac-46d6-a240-dcecbbf999e6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.570742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 807/1619] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:20.570742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6c623-015d-4d99-9acc-9893ac0eb6df None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.570742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6c623-015d-4d99-9acc-9893ac0eb6df None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.571837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6c623-015d-4d99-9acc-9893ac0eb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.597963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-90e6c623-015d-4d99-9acc-9893ac0eb6df None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:20.599349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-90e6c623-015d-4d99-9acc-9893ac0eb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:20.677952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5be704-96ac-46d6-a240-dcecbbf999e6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.688642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.689522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.689908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.690307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.691039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:20.693600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:20.761509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:20.771681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 813/1620] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/projects => generated 363 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:20.771681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.797116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 808/1621] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:20.798444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6c623-015d-4d99-9acc-9893ac0eb6df None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.915253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e46277-75d5-4e1c-a186-9c00ab941b27 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.925597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.926504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.926835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.928351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.930069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:20.930568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6c623-015d-4d99-9acc-9893ac0eb6df None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.933974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:20.976108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 814/1622] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:20.976909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.991824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db581031-89f0-4089-a6de-291e4b93bf19 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.998156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.998869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.999152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.999448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.000134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.002130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.014610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:21.030386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26c71a-3525-44d2-a2e2-98c8d840d9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.030990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c71a-3525-44d2-a2e2-98c8d840d9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.031323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c71a-3525-44d2-a2e2-98c8d840d9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.031598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c71a-3525-44d2-a2e2-98c8d840d9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.042247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26c71a-3525-44d2-a2e2-98c8d840d9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.049904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26c71a-3525-44d2-a2e2-98c8d840d9d8 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.053135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 815/1623] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:20 2022] POST /identity/v3/users => generated 288 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:21.054771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.059623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 809/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:21.061401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a702d7-68cd-4f2d-931f-ef76c3a9d35b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.061888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a702d7-68cd-4f2d-931f-ef76c3a9d35b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.062233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a702d7-68cd-4f2d-931f-ef76c3a9d35b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.064430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 810/1625] 10.222.0.25 () {54 vars in 912 bytes} [Mon Aug 8 02:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:21.065139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a702d7-68cd-4f2d-931f-ef76c3a9d35b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.080424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a702d7-68cd-4f2d-931f-ef76c3a9d35b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.088364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.089138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.089495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.089984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.090828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.092932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.110986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 811/1626] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:21.112097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.123582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5565-9d4f-40f4-bfd6-fc736776d296 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.130649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e3a5-3f63-4f4d-ab97-6de11525c1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.131596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e3a5-3f63-4f4d-ab97-6de11525c1dc admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.131875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e3a5-3f63-4f4d-ab97-6de11525c1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.133745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e3a5-3f63-4f4d-ab97-6de11525c1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.138704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e3a5-3f63-4f4d-ab97-6de11525c1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.141194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e3a5-3f63-4f4d-ab97-6de11525c1dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.166123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 812/1627] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:21.167651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c380fb-de4d-4a98-b7f4-07c93198c7d4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.169706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c380fb-de4d-4a98-b7f4-07c93198c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.170833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c380fb-de4d-4a98-b7f4-07c93198c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.215122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a7c380fb-de4d-4a98-b7f4-07c93198c7d4 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:21.215522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80055454-282e-486e-8143-2a43acf2aa60 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.218782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a7c380fb-de4d-4a98-b7f4-07c93198c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:21.228325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.228325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.229494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.230223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.241012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 813/1628] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:21.242697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c380fb-de4d-4a98-b7f4-07c93198c7d4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.265559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c380fb-de4d-4a98-b7f4-07c93198c7d4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.271647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.272449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.272887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.273164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] PATH_INFO: `/v3/projects/28b38cb2f80445a6b33388ff283a96ba/users/82c652ab806f41c5b5da8cd41baa165a/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.296660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b38cb2f80445a6b33388ff283a96ba, user_id=82c652ab806f41c5b5da8cd41baa165a, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.300883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.332155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 814/1629] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:21 2022] PUT /identity/v3/projects/28b38cb2f80445a6b33388ff283a96ba/users/82c652ab806f41c5b5da8cd41baa165a/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:21.334271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.344491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.347383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.362624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 816/1630] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:21.363956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.431950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18f78-4de5-499c-90e9-a99acb534249 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.438678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.439722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.440011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.440843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822572d7-c0cc-47ec-939e-4fb15917808d service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.440981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] PATH_INFO: `/v3/projects/bb03a9c407724c5f8f9664dcbaed6611/users/96bccf0bf5604854b04c88f35e926175/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.445486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:21.471587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb03a9c407724c5f8f9664dcbaed6611, user_id=96bccf0bf5604854b04c88f35e926175, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.478310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.500982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:21.505865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 815/1631] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:21 2022] PUT /identity/v3/projects/bb03a9c407724c5f8f9664dcbaed6611/users/96bccf0bf5604854b04c88f35e926175/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:21.506993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.507753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.508165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.509072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.514221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.619800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02bbf-8678-4e9a-b171-62d824f85146 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.628591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.629340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.629756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.630147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.631485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.634365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.635455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.637147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.655766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 816/1632] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:21.656849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.662983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 817/1633] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:21.664566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.673550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5cda1-12c9-40a9-b3f5-af02ec97f341 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.682121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.683244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.683745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.684192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.685006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.687666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.688901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c984588-18b5-4ebe-b7ee-ec3da4c64d5f service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.703718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8be12-1259-4818-8d51-d95cfcebd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.704701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8be12-1259-4818-8d51-d95cfcebd63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.705114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8be12-1259-4818-8d51-d95cfcebd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.705697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8be12-1259-4818-8d51-d95cfcebd63f admin admin] PATH_INFO: `/v3/projects/28b38cb2f80445a6b33388ff283a96ba/users/82c652ab806f41c5b5da8cd41baa165a/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.710471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8be12-1259-4818-8d51-d95cfcebd63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b38cb2f80445a6b33388ff283a96ba, user_id=82c652ab806f41c5b5da8cd41baa165a, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.713818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 817/1634] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:21.715561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:21.718330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8be12-1259-4818-8d51-d95cfcebd63f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.731121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0624f-919e-422a-ba4e-760581bb8a65 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:21.742953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 818/1635] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:21 2022] PUT /identity/v3/projects/28b38cb2f80445a6b33388ff283a96ba/users/82c652ab806f41c5b5da8cd41baa165a/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:21.753281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab7dee-8600-4c90-aaa7-e20ca7fc4c1d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.753585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab7dee-8600-4c90-aaa7-e20ca7fc4c1d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.755348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab7dee-8600-4c90-aaa7-e20ca7fc4c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.825663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9eab7dee-8600-4c90-aaa7-e20ca7fc4c1d None None] MFA Rules not processed for user `82c652ab806f41c5b5da8cd41baa165a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:21.830774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9eab7dee-8600-4c90-aaa7-e20ca7fc4c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:21.848206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885090da-f9ef-47f1-856b-7f842bc4a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:21.849124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885090da-f9ef-47f1-856b-7f842bc4a98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.849280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885090da-f9ef-47f1-856b-7f842bc4a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.849468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885090da-f9ef-47f1-856b-7f842bc4a98a admin admin] PATH_INFO: `/v3/projects/bb03a9c407724c5f8f9664dcbaed6611/users/96bccf0bf5604854b04c88f35e926175/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.851945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885090da-f9ef-47f1-856b-7f842bc4a98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb03a9c407724c5f8f9664dcbaed6611, user_id=96bccf0bf5604854b04c88f35e926175, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:21.855796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885090da-f9ef-47f1-856b-7f842bc4a98a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:21.880159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 818/1636] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:21 2022] PUT /identity/v3/projects/bb03a9c407724c5f8f9664dcbaed6611/users/96bccf0bf5604854b04c88f35e926175/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:21.891769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab061ee-acf0-4007-a206-8296a131496b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.891769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab061ee-acf0-4007-a206-8296a131496b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.891985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab061ee-acf0-4007-a206-8296a131496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.973545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 819/1637] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:21.976182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78dad6-f407-41ff-8dd2-3be447925d31 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.976499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78dad6-f407-41ff-8dd2-3be447925d31 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.976906 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78dad6-f407-41ff-8dd2-3be447925d31 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.979914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 820/1638] 10.222.0.25 () {54 vars in 912 bytes} [Mon Aug 8 02:33:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:21.985866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcd75c-d915-4cfc-8df3-663bdbc80ee4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:21.986447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcd75c-d915-4cfc-8df3-663bdbc80ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:21.986892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcd75c-d915-4cfc-8df3-663bdbc80ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:21.991074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bab061ee-acf0-4007-a206-8296a131496b None None] MFA Rules not processed for user `96bccf0bf5604854b04c88f35e926175`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:21.997474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bab061ee-acf0-4007-a206-8296a131496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:22.040950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a0fcd75c-d915-4cfc-8df3-663bdbc80ee4 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:22.042937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0fcd75c-d915-4cfc-8df3-663bdbc80ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:22.155104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:22.191716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:22.211297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 819/1639] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:22.211297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab061ee-acf0-4007-a206-8296a131496b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:22.236943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 821/1640] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:22.238278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcd75c-d915-4cfc-8df3-663bdbc80ee4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:22.345345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab061ee-acf0-4007-a206-8296a131496b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:22.349250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:22.349999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:22.350282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:22.350555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:22.391766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcd75c-d915-4cfc-8df3-663bdbc80ee4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:22.407303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:22.409078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:22.410433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:22.410977 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:22.426105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:22.429216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:22.446264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 822/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:22.512965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:22.514831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:22.529275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 820/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:22.604532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:22.618662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89801ed-789d-49e1-8f87-8522eee22788 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:22.632817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:22.633904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:22.634327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:22.634696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:22.669256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:22.669256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:22.696559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 823/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:22.914409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:22.923909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9b195-8e04-4a3d-9103-a9289f8327dd service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:22.936595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:22.937235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:22.937549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:22.937823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:23.072424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:23.073873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:23.098699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 821/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:23.372635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:23.387407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe353e-4e85-443e-b09d-2eb87de11a3e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:23.398301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db29367-d64d-4ecd-83b9-45a868cb842a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:23.402082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db29367-d64d-4ecd-83b9-45a868cb842a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:23.402435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db29367-d64d-4ecd-83b9-45a868cb842a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:23.402998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db29367-d64d-4ecd-83b9-45a868cb842a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:23.547069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db29367-d64d-4ecd-83b9-45a868cb842a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:23.548553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db29367-d64d-4ecd-83b9-45a868cb842a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:23.586428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 824/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:26.923157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:27.058016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:27.132896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee693ee-e07f-4d4f-8697-298f6c41ea55 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:27.141208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:27.141996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:27.142339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:27.142700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] PATH_INFO: `/v3/users/0b60e69a777c45b09b53250629596411` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:27.144254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b60e69a777c45b09b53250629596411)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:27.145357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:33:27.145357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: warnings.warn(msg) Aug 08 02:33:27.145357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: Aug 08 02:33:27.146945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:27.276249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b60e69a777c45b09b53250629596411'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:27.298111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b60e69a777c45b09b53250629596411'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:27.300806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b60e69a777c45b09b53250629596411'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:27.361476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b60e69a777c45b09b53250629596411'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:27.364474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b60e69a777c45b09b53250629596411'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:27.418333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 822/1646] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:26 2022] DELETE /identity/v3/users/0b60e69a777c45b09b53250629596411 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:33:27.422746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:27.423620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:27.424097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:27.483010 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:27.489553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:27.676810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 825/1647] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:27.768545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:27.770913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:28.030370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a218ae-bd15-46c4-8cdd-47940ff78fc9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:28.054654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:28.056507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:28.058195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:28.059289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:28.086986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:28.093817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:28.142663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 823/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:30.294655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:30.296229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:30.334062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5070a-a79c-42bd-a942-52e8abb6450e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:30.353994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:30.359356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:30.359356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:30.359356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] PATH_INFO: `/v3/projects/2b00cb60924c4a38af5f1f8c0864988b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:30.360661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b00cb60924c4a38af5f1f8c0864988b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:30.361206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:30.362672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:30.363493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: WARNING py.warnings [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:33:30.363493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: warnings.warn(msg) Aug 08 02:33:30.363493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: Aug 08 02:33:30.366330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:30.387211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18b01c-6a25-4a63-a910-3ef4e0c29431 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:30.401200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:30.403136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:30.404205 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:30.404553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] PATH_INFO: `/v3/users/154d593430de4ac29acf8c1c1f4ce5fe` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:30.410021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154d593430de4ac29acf8c1c1f4ce5fe)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:30.416952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:30.433429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:30.577735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154d593430de4ac29acf8c1c1f4ce5fe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.583110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:30.594105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154d593430de4ac29acf8c1c1f4ce5fe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.596004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154d593430de4ac29acf8c1c1f4ce5fe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.599908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b00cb60924c4a38af5f1f8c0864988b', 'request_id': 'req-c1ed642f-8590-41b7-a41b-675bd01841a6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.628657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154d593430de4ac29acf8c1c1f4ce5fe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.629912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91da3675-62ac-47aa-bb0f-9066ecc0c615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154d593430de4ac29acf8c1c1f4ce5fe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.651458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 824/1649] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:30 2022] DELETE /identity/v3/users/154d593430de4ac29acf8c1c1f4ce5fe => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:30.654609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e82d46-7fde-4fe5-b959-7e028886621b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:30.655099 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e82d46-7fde-4fe5-b959-7e028886621b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:30.655598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e82d46-7fde-4fe5-b959-7e028886621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:30.665498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b00cb60924c4a38af5f1f8c0864988b', 'request_id': 'req-c1ed642f-8590-41b7-a41b-675bd01841a6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.693822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b00cb60924c4a38af5f1f8c0864988b', 'request_id': 'req-c1ed642f-8590-41b7-a41b-675bd01841a6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.726672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] The token cache is being invalidate because project 2b00cb60924c4a38af5f1f8c0864988b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:30.727795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.729013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-38e82d46-7fde-4fe5-b959-7e028886621b None None] MFA Rules not processed for user `d2194dacd30e45bd87d38b70d1b3bbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:30.731354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c1ed642f-8590-41b7-a41b-675bd01841a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:30.734087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-38e82d46-7fde-4fe5-b959-7e028886621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:30.735295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 826/1650] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:30 2022] DELETE /identity/v3/projects/2b00cb60924c4a38af5f1f8c0864988b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:30.741990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046110-5fc0-4365-ab86-bdd591043c98 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:30.743260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046110-5fc0-4365-ab86-bdd591043c98 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:30.744495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046110-5fc0-4365-ab86-bdd591043c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:30.845721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-24046110-5fc0-4365-ab86-bdd591043c98 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:30.849823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24046110-5fc0-4365-ab86-bdd591043c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:30.934379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 825/1651] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:30.936369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94893-b570-420d-af45-8899ca584fae None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:30.936369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94893-b570-420d-af45-8899ca584fae None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:30.936701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94893-b570-420d-af45-8899ca584fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:30.967597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3da94893-b570-420d-af45-8899ca584fae None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:30.970948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3da94893-b570-420d-af45-8899ca584fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:31.006887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 827/1652] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:31.008652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c54f4-e409-44b7-b022-8bfaf7ef709a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.009359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c54f4-e409-44b7-b022-8bfaf7ef709a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.009965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c54f4-e409-44b7-b022-8bfaf7ef709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.109253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-191c54f4-e409-44b7-b022-8bfaf7ef709a None None] MFA Rules not processed for user `0aa7040691be4940a0059eac5d638109`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:31.118351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-191c54f4-e409-44b7-b022-8bfaf7ef709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:31.133419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 826/1653] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:31.139239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.139535 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.139815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.198515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] MFA Rules not processed for user `d2194dacd30e45bd87d38b70d1b3bbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:31.199898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:31.228131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 827/1654] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:31.229261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:31.232900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:31.287659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 828/1655] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:31.297016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.297697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.298072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.338777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:31.347315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:31.363686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0495-d099-4e03-9a8c-354efc8d54d1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:31.366307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 829/1656] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:31.367424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:31.371171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:31.379784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:31.383990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.384279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.384565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.401886 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:31.407059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:31.411415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:31.435078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 828/1657] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:31.435969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:31.437986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:31.474866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:31.559676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d96af-32b6-4e6e-a7ae-e06a7fc9eca8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:31.567661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:31.569125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.569784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.570471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.575044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2642f-940c-4526-a3a1-58db07fb5273 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:31.589914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:31.596090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:31.606809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:31.607502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.607785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.608051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.620498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 830/1658] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:31.621915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:31.647303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e389b-52bb-41ce-8e4a-54ccb0c74e6f service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:31.654758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:31.658918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:31.659838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:31.660722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.661148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.666234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.667326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:31.667798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:31.669915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:31.690102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 829/1659] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:31.711269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 831/1660] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:31.716920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:31.739574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828c96-3f1a-443c-87d3-6566daf45e83 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:31.764173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:31.765238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:31.765436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:31.765673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:31.774561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:31.779203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:31.893457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:31.894205 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 830/1661] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:31 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:31.911291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f26d4-fa8f-4ad2-9f19-3094e160366d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:31.912461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:31.914972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:32.125081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:32.125656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.127016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.127016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.127016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:32.128849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:32.145159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754db15-a067-47af-8101-b76f01f0b16e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:32.162944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:32.166588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.166588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.166588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] PATH_INFO: `/v3/users/d1cd3355c686459f960043ad2e3a26ee` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.170058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cd3355c686459f960043ad2e3a26ee)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:32.182276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:32.184130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 832/1662] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:31 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:33:32.185214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:32.218331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930e0d-3942-4d47-80db-fb6778cffafa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:32.230457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:32.231096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.231373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.231684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.232346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:32.234002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:32.273991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 833/1663] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:32.286077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:32.296119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cd3355c686459f960043ad2e3a26ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:32.314634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349b58-8591-47fe-8b5e-169888baa352 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:32.323543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cd3355c686459f960043ad2e3a26ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:32.324420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cd3355c686459f960043ad2e3a26ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:32.333075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:32.336807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:32.338175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.338521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.341017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.341726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:32.350267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:32.365341 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cd3355c686459f960043ad2e3a26ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:32.372459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8afa239a-ec35-4d1e-a95a-6964bb73f4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cd3355c686459f960043ad2e3a26ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:32.399566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 834/1664] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:32.401787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:32.406295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 831/1665] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:31 2022] DELETE /identity/v3/users/d1cd3355c686459f960043ad2e3a26ee => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:32.407183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:32.413477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af4170-cac9-47e8-afa7-2a4143c84b31 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.413909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af4170-cac9-47e8-afa7-2a4143c84b31 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.414343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af4170-cac9-47e8-afa7-2a4143c84b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.442281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96901b-dd9a-4681-915c-469a5160edfc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:32.474628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-48af4170-cac9-47e8-afa7-2a4143c84b31 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:32.475993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-48af4170-cac9-47e8-afa7-2a4143c84b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:32.579326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:32.580018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.580297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.580573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] PATH_INFO: `/v3/projects/7aeeb2494e664c82a21d559aac27d5e3/users/c5a43d7fe5344a0383dc058a29454a4e/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.651168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:32.654031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 832/1666] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:32.656301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aeeb2494e664c82a21d559aac27d5e3, user_id=c5a43d7fe5344a0383dc058a29454a4e, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:32.659560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:32.693279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 835/1667] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:32 2022] PUT /identity/v3/projects/7aeeb2494e664c82a21d559aac27d5e3/users/c5a43d7fe5344a0383dc058a29454a4e/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:32.705275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121af13-7b38-4e54-be48-5edc8ede0953 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.706214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121af13-7b38-4e54-be48-5edc8ede0953 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.707040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:32.707315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121af13-7b38-4e54-be48-5edc8ede0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.712972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:32.801481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2121af13-7b38-4e54-be48-5edc8ede0953 None None] MFA Rules not processed for user `c5a43d7fe5344a0383dc058a29454a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:32.803771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2121af13-7b38-4e54-be48-5edc8ede0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:32.899770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd851a-f37a-4695-ad0b-629c152bd219 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:32.909628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:32.910494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:32.911342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:32.912359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:32.973839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 833/1668] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:32.974895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121af13-7b38-4e54-be48-5edc8ede0953 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:33.108118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:33.112260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:33.149698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 836/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:33.153632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:33.158267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:33.178110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121af13-7b38-4e54-be48-5edc8ede0953 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:33.187362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae3734-df7d-46f7-8e40-82e2d98e8879 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:33.189725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ea102-ebfc-40ad-8781-1696d6d78f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:33.191051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea102-ebfc-40ad-8781-1696d6d78f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.191342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea102-ebfc-40ad-8781-1696d6d78f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.191866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea102-ebfc-40ad-8781-1696d6d78f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.193936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ea102-ebfc-40ad-8781-1696d6d78f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:33.198058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ea102-ebfc-40ad-8781-1696d6d78f1e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:33.204169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:33.205934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.205934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.206792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] PATH_INFO: `/v3/users/b75869e43eaa48458cdf5ff6f3a08447` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.210353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75869e43eaa48458cdf5ff6f3a08447)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:33.215149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:33.250996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:33.291328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 834/1670] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:32 2022] POST /identity/v3/projects => generated 363 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:33.293017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9a73e-6289-45cd-913a-3447d3fe93dd None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.293385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9a73e-6289-45cd-913a-3447d3fe93dd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.294275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9a73e-6289-45cd-913a-3447d3fe93dd None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.296454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 835/1671] 10.222.0.25 () {54 vars in 912 bytes} [Mon Aug 8 02:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:33.304870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9a73e-6289-45cd-913a-3447d3fe93dd None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:33.352250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75869e43eaa48458cdf5ff6f3a08447'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:33.371925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75869e43eaa48458cdf5ff6f3a08447'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:33.401226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75869e43eaa48458cdf5ff6f3a08447'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:33.405879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75869e43eaa48458cdf5ff6f3a08447'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:33.408195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59ad9245-c8ff-4e79-8e1f-a416faf6386d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75869e43eaa48458cdf5ff6f3a08447'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:33.464806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 837/1672] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:33 2022] DELETE /identity/v3/users/b75869e43eaa48458cdf5ff6f3a08447 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:33.468350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.468641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.470713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.485724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9a73e-6289-45cd-913a-3447d3fe93dd None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:33.547276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:33.600004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] MFA Rules not processed for user `64c5c41465004c0a81fced6e8834a5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:33.606616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:33.714992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c73faa-1085-4bd5-8e99-86ab3dcb0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:33.715641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73faa-1085-4bd5-8e99-86ab3dcb0486 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.715923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73faa-1085-4bd5-8e99-86ab3dcb0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.716203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73faa-1085-4bd5-8e99-86ab3dcb0486 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.716857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c73faa-1085-4bd5-8e99-86ab3dcb0486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:33.718907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c73faa-1085-4bd5-8e99-86ab3dcb0486 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:33.802105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 836/1673] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:33 2022] POST /identity/v3/users => generated 288 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:33:33.803613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.803903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.804180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.816860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 838/1674] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:33.818182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:33.823730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:33.874841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:33.877142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6294d-710b-4207-adeb-f5f820681c16 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:33.881776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:33.894980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:33.898993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.899397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.901524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] PATH_INFO: `/v3/projects/9947d40ca2d1401797f9a236038d7ad6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.904436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9947d40ca2d1401797f9a236038d7ad6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:33.909922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 837/1675] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:33.913072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:33.913344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:33.918311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:33.959314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc8a8-483f-46d2-9a2a-fed290042716 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:33.984114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:33.984815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:33.986942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:33.987323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:33.987906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:33.989627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:34.032093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 838/1676] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:34.038907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:34.050288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.081454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9947d40ca2d1401797f9a236038d7ad6', 'request_id': 'req-926f365a-fc50-4196-b2a7-c379c17c3b47'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:34.093878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf6521-0e53-4e5e-ab89-d1aae823437d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:34.106483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9947d40ca2d1401797f9a236038d7ad6', 'request_id': 'req-926f365a-fc50-4196-b2a7-c379c17c3b47'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:34.136376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9947d40ca2d1401797f9a236038d7ad6', 'request_id': 'req-926f365a-fc50-4196-b2a7-c379c17c3b47'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:34.164089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] The token cache is being invalidate because project 9947d40ca2d1401797f9a236038d7ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:34.164520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:34.176310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:34.182752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 839/1677] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:33 2022] DELETE /identity/v3/projects/9947d40ca2d1401797f9a236038d7ad6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:34.186934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:34.190572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.299647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:34.300306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:34.300586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:34.300865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:34.319937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.366216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:34.367741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:34.395286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 839/1678] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:34.396491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:34.398082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.418992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f365a-fc50-4196-b2a7-c379c17c3b47 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:34.427921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e847a6-2d20-42db-8e08-2e85cb0317dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:34.428598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e847a6-2d20-42db-8e08-2e85cb0317dc service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:34.428893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e847a6-2d20-42db-8e08-2e85cb0317dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:34.429243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e847a6-2d20-42db-8e08-2e85cb0317dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:34.431721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e5e847a6-2d20-42db-8e08-2e85cb0317dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.463890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:34.553000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:34.589644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fca4-6786-4511-98ca-4661fd800ecc service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:34.592892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e847a6-2d20-42db-8e08-2e85cb0317dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:34.594405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e847a6-2d20-42db-8e08-2e85cb0317dc service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:34.598321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:34.599027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:34.599302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:34.599578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] PATH_INFO: `/v3/projects/6d09d9ab26fe460e8b04c27201a1d94f/users/e458a6fb6bd649669474ff1c8e51c143/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:34.625524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 840/1679] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:34.626525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:34.626779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:34.627059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:34.644459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d09d9ab26fe460e8b04c27201a1d94f, user_id=e458a6fb6bd649669474ff1c8e51c143, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:34.653506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:34.678137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:34.679305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.695968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 841/1680] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:34.698741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 840/1681] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:34 2022] PUT /identity/v3/projects/6d09d9ab26fe460e8b04c27201a1d94f/users/e458a6fb6bd649669474ff1c8e51c143/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:34.698867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:34.700508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.706700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:34.707963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:34.739431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922782f-812d-476e-94d5-4f5dd0c4a8fc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:34.896339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:34.897100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:34.897578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:34.897864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] PATH_INFO: `/v3/users/871885f0bb9843b3a5b10b2adeee6dde` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:34.900059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871885f0bb9843b3a5b10b2adeee6dde)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:34.903694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd57409-f2b8-4225-bc69-e606fc07f870 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:34.905798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:34.921627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:34.923899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:34.925231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:34.925717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] PATH_INFO: `/v3/projects/f9f3b6d0b9e2466ab1bd7089ae1859d7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:34.943470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f3b6d0b9e2466ab1bd7089ae1859d7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:34.945834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:35.003751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871885f0bb9843b3a5b10b2adeee6dde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.041810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871885f0bb9843b3a5b10b2adeee6dde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.066596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f3b6d0b9e2466ab1bd7089ae1859d7', 'request_id': 'req-91342e41-86ec-4aef-8ba4-171d85e0b31f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.071354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871885f0bb9843b3a5b10b2adeee6dde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.072850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871885f0bb9843b3a5b10b2adeee6dde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.073783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e04c95f9-218f-4cd8-be4f-99af5a1f5408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871885f0bb9843b3a5b10b2adeee6dde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.081322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f3b6d0b9e2466ab1bd7089ae1859d7', 'request_id': 'req-91342e41-86ec-4aef-8ba4-171d85e0b31f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.097442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 842/1682] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:34 2022] DELETE /identity/v3/users/871885f0bb9843b3a5b10b2adeee6dde => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:35.099636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccbc57-0c6e-4c88-9485-d066ae577d57 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.100087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccbc57-0c6e-4c88-9485-d066ae577d57 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.100527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccbc57-0c6e-4c88-9485-d066ae577d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.103578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f3b6d0b9e2466ab1bd7089ae1859d7', 'request_id': 'req-91342e41-86ec-4aef-8ba4-171d85e0b31f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.124531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] The token cache is being invalidate because project f9f3b6d0b9e2466ab1bd7089ae1859d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:35.124829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.127806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.133229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 841/1683] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:34 2022] DELETE /identity/v3/projects/f9f3b6d0b9e2466ab1bd7089ae1859d7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:35.136269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:35.138028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.139807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-48ccbc57-0c6e-4c88-9485-d066ae577d57 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:35.141585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-48ccbc57-0c6e-4c88-9485-d066ae577d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.211046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:35.273938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:35.297966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91342e41-86ec-4aef-8ba4-171d85e0b31f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:35.307563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:35.307990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 843/1684] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:35.309496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c5d6-d61e-412a-be04-e4782763ccea None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.309676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c5d6-d61e-412a-be04-e4782763ccea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.309911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c5d6-d61e-412a-be04-e4782763ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.311734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.312077 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.312361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.315660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:35.317317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:35.333059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 842/1685] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:35.333059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:35.335384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.361663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c250c5d6-d61e-412a-be04-e4782763ccea None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:35.362901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c250c5d6-d61e-412a-be04-e4782763ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.371239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c5aa-d1d0-41d3-b9ff-5ff3ed00620b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:35.377202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:35.378791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.379177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.379456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] PATH_INFO: `/v3/users/96bccf0bf5604854b04c88f35e926175` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.380780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bccf0bf5604854b04c88f35e926175)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:35.383266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:35.387492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 844/1686] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:35.389687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c5d6-d61e-412a-be04-e4782763ccea None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:35.425093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c5d6-d61e-412a-be04-e4782763ccea None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:35.436592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:35.437724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.438450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.438983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.441768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:35.442215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:35.444517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:35.479203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 845/1687] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:35.480414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:35.497743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69d160-0f6b-4179-ad96-aa7c5de17419 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:35.501209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bccf0bf5604854b04c88f35e926175'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.507706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:35.508799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.509189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.509731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] PATH_INFO: `/v3/projects/6d09d9ab26fe460e8b04c27201a1d94f/users/e458a6fb6bd649669474ff1c8e51c143/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.513399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d09d9ab26fe460e8b04c27201a1d94f, user_id=e458a6fb6bd649669474ff1c8e51c143, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:35.520597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:35.533012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bccf0bf5604854b04c88f35e926175'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.533700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bccf0bf5604854b04c88f35e926175'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.554550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 846/1688] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:35 2022] PUT /identity/v3/projects/6d09d9ab26fe460e8b04c27201a1d94f/users/e458a6fb6bd649669474ff1c8e51c143/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:35.569784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:35.575200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.576460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bccf0bf5604854b04c88f35e926175'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.577233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bccf0bf5604854b04c88f35e926175'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:35.630419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 843/1689] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:35 2022] DELETE /identity/v3/users/96bccf0bf5604854b04c88f35e926175 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:35.633098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:35.635957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.732938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d76782-eb68-451b-9314-c0ac99228c63 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:35.829047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df56f5-7d43-425c-ab8b-1eb95a50d7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:35.829708 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df56f5-7d43-425c-ab8b-1eb95a50d7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.829986 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df56f5-7d43-425c-ab8b-1eb95a50d7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.830254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df56f5-7d43-425c-ab8b-1eb95a50d7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.832726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d4df56f5-7d43-425c-ab8b-1eb95a50d7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.847758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df56f5-7d43-425c-ab8b-1eb95a50d7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:35.849480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df56f5-7d43-425c-ab8b-1eb95a50d7b4 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:35.854780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855543f8-fc15-4b9e-abad-64335044a976 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:35.862889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 847/1690] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:35.864462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6901a-2cc3-4459-a62f-ebfeb9992c60 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.864926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c37711-c0b0-4761-9789-77db4d14d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:35.865297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6901a-2cc3-4459-a62f-ebfeb9992c60 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.865593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37711-c0b0-4761-9789-77db4d14d42c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.865873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37711-c0b0-4761-9789-77db4d14d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.866146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37711-c0b0-4761-9789-77db4d14d42c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.866387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6901a-2cc3-4459-a62f-ebfeb9992c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:35.866782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c37711-c0b0-4761-9789-77db4d14d42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:35.868988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c37711-c0b0-4761-9789-77db4d14d42c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:35.915756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5b6901a-2cc3-4459-a62f-ebfeb9992c60 None None] MFA Rules not processed for user `e458a6fb6bd649669474ff1c8e51c143`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:35.917593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5b6901a-2cc3-4459-a62f-ebfeb9992c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:35.947105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 844/1691] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:35 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:35.947105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:35.947105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:35.947471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.013100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] MFA Rules not processed for user `d91359eb2ecb4b7391f579732a596602`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:36.017798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:36.042577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:36.095505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 848/1692] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:36.105157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6901a-2cc3-4459-a62f-ebfeb9992c60 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:36.129349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6901a-2cc3-4459-a62f-ebfeb9992c60 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:36.139495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:36.202855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 845/1693] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:36.203544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:36.213044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:36.271743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a81a6-cc05-446c-bd62-3131d62e4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:36.271743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a81a6-cc05-446c-bd62-3131d62e4123 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:36.271743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a81a6-cc05-446c-bd62-3131d62e4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:36.271743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a81a6-cc05-446c-bd62-3131d62e4123 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.272296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a81a6-cc05-446c-bd62-3131d62e4123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:36.272296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a81a6-cc05-446c-bd62-3131d62e4123 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:36.335155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 849/1694] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:36 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:36.336945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cd830-e9b6-4840-907f-7a31ac9437ac None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:36.337355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cd830-e9b6-4840-907f-7a31ac9437ac None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:36.338029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cd830-e9b6-4840-907f-7a31ac9437ac None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.349039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 850/1695] 10.222.0.25 () {54 vars in 961 bytes} [Mon Aug 8 02:33:36 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:36.352449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4e00c-3a94-4ed0-9909-363dea8108a9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:36.352738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4e00c-3a94-4ed0-9909-363dea8108a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:36.353019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4e00c-3a94-4ed0-9909-363dea8108a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.360645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f4f4c-aeab-430a-8afb-6c3f5b315d24 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:36.368002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:36.368647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:36.370057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:36.370354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.399259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4cb4e00c-3a94-4ed0-9909-363dea8108a9 None None] MFA Rules not processed for user `d91359eb2ecb4b7391f579732a596602`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:36.403935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4cb4e00c-3a94-4ed0-9909-363dea8108a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:36.426925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 851/1696] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:36.426925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4e00c-3a94-4ed0-9909-363dea8108a9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:36.447207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4e00c-3a94-4ed0-9909-363dea8108a9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:36.460841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ea11f-be92-4ad1-8cb1-5ec695916505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:36.461868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ea11f-be92-4ad1-8cb1-5ec695916505 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:36.462292 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ea11f-be92-4ad1-8cb1-5ec695916505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:36.462565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ea11f-be92-4ad1-8cb1-5ec695916505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.463239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ea11f-be92-4ad1-8cb1-5ec695916505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:36.464875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ea11f-be92-4ad1-8cb1-5ec695916505 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:36.491100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 852/1697] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:36.497242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:36.497579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:36.497854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.513819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:36.515208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:36.537839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:36.539061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:36.543479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 846/1698] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:36.550952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:36.558459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:36.601204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20e79-8b3f-4438-85e5-81dec0e3cd5a service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:36.627715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:36.629345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:36.629345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:36.629345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] PATH_INFO: `/v3/projects/c45e176ea4ab4bf59975895aa26ac4df` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:36.634707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45e176ea4ab4bf59975895aa26ac4df)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:36.636233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:36.757589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 853/1699] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Aug 8 02:33:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:36.767843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:36.773717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:36.786018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45e176ea4ab4bf59975895aa26ac4df', 'request_id': 'req-01c0afef-6348-4070-bcda-3b386b93443c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:36.802037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45e176ea4ab4bf59975895aa26ac4df', 'request_id': 'req-01c0afef-6348-4070-bcda-3b386b93443c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:36.817221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:36.840910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45e176ea4ab4bf59975895aa26ac4df', 'request_id': 'req-01c0afef-6348-4070-bcda-3b386b93443c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:36.856599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] The token cache is being invalidate because project c45e176ea4ab4bf59975895aa26ac4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:36.859637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:36.865925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:36.868225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 847/1700] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:36 2022] DELETE /identity/v3/projects/c45e176ea4ab4bf59975895aa26ac4df => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:36.868751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:36.870344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.025025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0afef-6348-4070-bcda-3b386b93443c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:37.028388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83682c4-ecd0-41f4-8d53-cda762a5f592 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:37.032246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:37.032914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:37.034141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:37.034607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:37.035815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:37.041465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:37.053916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:37.056319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 848/1701] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:37.057575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:37.064152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.155967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:37.156307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:37.156798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:37.157764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:37.160055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.165986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57756653-1f42-4ada-965a-1f97e0cf32a4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:37.169925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bfc00-4059-473a-8f96-fb6e1848816d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:37.170613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bfc00-4059-473a-8f96-fb6e1848816d service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:37.170950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bfc00-4059-473a-8f96-fb6e1848816d service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:37.171280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bfc00-4059-473a-8f96-fb6e1848816d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:37.173203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f16bfc00-4059-473a-8f96-fb6e1848816d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.237398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:37.239763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:37.251522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 854/1702] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:37.263964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bfc00-4059-473a-8f96-fb6e1848816d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:37.264211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:37.267789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.268080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bfc00-4059-473a-8f96-fb6e1848816d service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:37.289166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 849/1703] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:37.291916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:37.292446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:37.292861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:37.327980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] MFA Rules not processed for user `0aa7040691be4940a0059eac5d638109`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:37.328899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.438023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:37.482319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 850/1704] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:37.482319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:37.482319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.494097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c66a5-5e27-49e2-bef8-99c0d7cb3887 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:37.495707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d47c5-b074-420b-b174-e7280d0b7b54 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:37.500672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:37.501320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:37.501623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:37.501947 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] PATH_INFO: `/v3/users/82c652ab806f41c5b5da8cd41baa165a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:37.503291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c652ab806f41c5b5da8cd41baa165a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:37.505304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:37.522504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:37.523158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:37.523429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:37.524209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:37.534398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.573791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:37.575447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:37.587599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c652ab806f41c5b5da8cd41baa165a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.627413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c652ab806f41c5b5da8cd41baa165a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.629452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c652ab806f41c5b5da8cd41baa165a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.635687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 855/1705] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:37.636720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:37.649604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.675798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c652ab806f41c5b5da8cd41baa165a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.680220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c652ab806f41c5b5da8cd41baa165a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.692515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e76b4f-20e8-4fc5-b128-cb6cfbb3269f service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:37.710409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:37.711958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:37.712383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:37.712761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] PATH_INFO: `/v3/projects/bb03a9c407724c5f8f9664dcbaed6611` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:37.716362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb03a9c407724c5f8f9664dcbaed6611)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:37.727894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:37.737121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 851/1706] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:37 2022] DELETE /identity/v3/users/82c652ab806f41c5b5da8cd41baa165a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:37.737121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:37.738675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:37.850928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:37.886090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb03a9c407724c5f8f9664dcbaed6611', 'request_id': 'req-7b3bc33a-e4da-431e-9aed-80566e834853'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.911477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb03a9c407724c5f8f9664dcbaed6611', 'request_id': 'req-7b3bc33a-e4da-431e-9aed-80566e834853'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.911618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0077-d1a2-4cf4-add5-23582d7f1464 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:37.930466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb03a9c407724c5f8f9664dcbaed6611', 'request_id': 'req-7b3bc33a-e4da-431e-9aed-80566e834853'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.966006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] The token cache is being invalidate because project bb03a9c407724c5f8f9664dcbaed6611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:37.967494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.984768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:37.991292 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 856/1707] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:37 2022] DELETE /identity/v3/projects/bb03a9c407724c5f8f9664dcbaed6611 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:38.002929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:38.019133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:38.100404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:38.109210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.110349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.111725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] PATH_INFO: `/v3/projects/298b12a46ddf44cb88b39fc05a0119ff` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.115202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=298b12a46ddf44cb88b39fc05a0119ff)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:38.118605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:38.122073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:38.229319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bc33a-e4da-431e-9aed-80566e834853 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:38.251572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f20be-75aa-4622-9b52-193235378341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:38.253083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f20be-75aa-4622-9b52-193235378341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.253647 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f20be-75aa-4622-9b52-193235378341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.255950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f20be-75aa-4622-9b52-193235378341 admin admin] PATH_INFO: `/v3/projects/cd21ccfee6c74336bad3b1503e868bc2/users/83969c75a68c44219c4d5ae9c3bf4f52/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.294395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f20be-75aa-4622-9b52-193235378341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd21ccfee6c74336bad3b1503e868bc2, user_id=83969c75a68c44219c4d5ae9c3bf4f52, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:38.300570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f20be-75aa-4622-9b52-193235378341 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:38.317531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298b12a46ddf44cb88b39fc05a0119ff', 'request_id': 'req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.333256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 857/1708] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:37 2022] PUT /identity/v3/projects/cd21ccfee6c74336bad3b1503e868bc2/users/83969c75a68c44219c4d5ae9c3bf4f52/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:38.342136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298b12a46ddf44cb88b39fc05a0119ff', 'request_id': 'req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.342600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0376-643d-4786-9995-c8280c901ba7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.342600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0376-643d-4786-9995-c8280c901ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.342600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0376-643d-4786-9995-c8280c901ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.359142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298b12a46ddf44cb88b39fc05a0119ff', 'request_id': 'req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.393414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] The token cache is being invalidate because project 298b12a46ddf44cb88b39fc05a0119ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:38.393714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.396430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-690b0376-643d-4786-9995-c8280c901ba7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:38.396574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a5c051b9-ab70-452e-89c7-fa0f52fed5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.397159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-690b0376-643d-4786-9995-c8280c901ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:38.401697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 852/1709] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:37 2022] DELETE /identity/v3/projects/298b12a46ddf44cb88b39fc05a0119ff => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:38.404690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2dd58-79e0-498e-9694-57532188a74c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.404981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2dd58-79e0-498e-9694-57532188a74c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.405259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2dd58-79e0-498e-9694-57532188a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.500508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3bc2dd58-79e0-498e-9694-57532188a74c None None] MFA Rules not processed for user `83969c75a68c44219c4d5ae9c3bf4f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:38.505309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3bc2dd58-79e0-498e-9694-57532188a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:38.589450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 858/1710] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:38.591826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.592684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.592684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.661957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:38.667342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:38.670163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 853/1711] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:38.671523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2431d-eb46-4a2e-b806-2b105f20e751 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.672002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2431d-eb46-4a2e-b806-2b105f20e751 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.672377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2431d-eb46-4a2e-b806-2b105f20e751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.693554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 859/1712] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:38.694605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:38.695734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a3d2431d-eb46-4a2e-b806-2b105f20e751 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:38.696991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a3d2431d-eb46-4a2e-b806-2b105f20e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:38.700750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:38.708208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 854/1713] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:38.709502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603fb6-b626-4f84-adea-b8000f58dca1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.713095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603fb6-b626-4f84-adea-b8000f58dca1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.713450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603fb6-b626-4f84-adea-b8000f58dca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.743958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450445ea-5dde-4ac3-9c52-2de9507a0733 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:38.761581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:38.764737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.765239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.765725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] PATH_INFO: `/v3/projects/28b38cb2f80445a6b33388ff283a96ba` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.768074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b38cb2f80445a6b33388ff283a96ba)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:38.782061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6a603fb6-b626-4f84-adea-b8000f58dca1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:38.783549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6a603fb6-b626-4f84-adea-b8000f58dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:38.787495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:38.809680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 855/1714] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:38.809680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603fb6-b626-4f84-adea-b8000f58dca1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:38.830413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603fb6-b626-4f84-adea-b8000f58dca1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:38.851489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:38.852330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:38.865316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:38.866243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:38.866530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:38.866846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:38.868876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:38.869504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:38.885692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b38cb2f80445a6b33388ff283a96ba', 'request_id': 'req-5cd06022-e738-45e4-a6d0-16e8b0caccf4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.901299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b38cb2f80445a6b33388ff283a96ba', 'request_id': 'req-5cd06022-e738-45e4-a6d0-16e8b0caccf4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.909929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 856/1715] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:38.911840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:38.928494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b38cb2f80445a6b33388ff283a96ba', 'request_id': 'req-5cd06022-e738-45e4-a6d0-16e8b0caccf4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.935941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d45a7-d60d-4bba-8493-77c88f0ffa46 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:38.945463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] The token cache is being invalidate because project 28b38cb2f80445a6b33388ff283a96ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:38.946733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.947960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:38.952869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 860/1716] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:38 2022] DELETE /identity/v3/projects/28b38cb2f80445a6b33388ff283a96ba => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:38.952869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:38.954115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:39.042677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:39.064206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4162-24ab-472e-9de4-c5626076eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.064206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4162-24ab-472e-9de4-c5626076eb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.064645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4162-24ab-472e-9de4-c5626076eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.064645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4162-24ab-472e-9de4-c5626076eb85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.067615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e4162-24ab-472e-9de4-c5626076eb85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:39.071566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e4162-24ab-472e-9de4-c5626076eb85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.077450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e4162-24ab-472e-9de4-c5626076eb85 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.081005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06022-e738-45e4-a6d0-16e8b0caccf4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.095926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.096817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.096972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.097161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.097836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.099878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.108712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 857/1717] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:39.110899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366018df-0b3a-4d05-b7db-39d784632b94 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.111695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366018df-0b3a-4d05-b7db-39d784632b94 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.112001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366018df-0b3a-4d05-b7db-39d784632b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.152427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-366018df-0b3a-4d05-b7db-39d784632b94 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:39.156358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-366018df-0b3a-4d05-b7db-39d784632b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:39.163314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 861/1718] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:38 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:39.164526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.167832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:39.169296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 858/1719] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:39.170396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366018df-0b3a-4d05-b7db-39d784632b94 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.193355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366018df-0b3a-4d05-b7db-39d784632b94 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.343561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e99f1-4041-4c67-9652-4e263f352ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.344108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e99f1-4041-4c67-9652-4e263f352ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.344387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e99f1-4041-4c67-9652-4e263f352ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.344659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e99f1-4041-4c67-9652-4e263f352ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.345292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e99f1-4041-4c67-9652-4e263f352ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.347397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e99f1-4041-4c67-9652-4e263f352ed3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.359165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a0127-d767-4406-93d7-a325efd6ccc4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.371601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd694983-0804-4647-9576-39451dfaba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.372546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd694983-0804-4647-9576-39451dfaba7c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.373146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd694983-0804-4647-9576-39451dfaba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.373146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd694983-0804-4647-9576-39451dfaba7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.380652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd694983-0804-4647-9576-39451dfaba7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.380652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd694983-0804-4647-9576-39451dfaba7c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.406962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 859/1720] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:39 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:39.408648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363268-1fc0-485e-85a5-982abe703a8f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.409083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363268-1fc0-485e-85a5-982abe703a8f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.410620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363268-1fc0-485e-85a5-982abe703a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.456468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 862/1721] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:39 2022] POST /identity/v3/projects => generated 405 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:39.459692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f732e1e-0ad5-4233-9668-719a5c03c699 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.459982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f732e1e-0ad5-4233-9668-719a5c03c699 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.460253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f732e1e-0ad5-4233-9668-719a5c03c699 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.464241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-10363268-1fc0-485e-85a5-982abe703a8f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:39.466778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 863/1722] 10.222.0.25 () {54 vars in 912 bytes} [Mon Aug 8 02:33:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:39.467986 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f732e1e-0ad5-4233-9668-719a5c03c699 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.468472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-10363268-1fc0-485e-85a5-982abe703a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:39.557962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 860/1723] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:39.559094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363268-1fc0-485e-85a5-982abe703a8f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.561249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:39.574467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363268-1fc0-485e-85a5-982abe703a8f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.590593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24347f00-43ab-4709-a17c-165c4e3c1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.591485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24347f00-43ab-4709-a17c-165c4e3c1024 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.591944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24347f00-43ab-4709-a17c-165c4e3c1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.592280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24347f00-43ab-4709-a17c-165c4e3c1024 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.593505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24347f00-43ab-4709-a17c-165c4e3c1024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.598866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24347f00-43ab-4709-a17c-165c4e3c1024 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.657279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 861/1724] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:39 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:39.661565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470afd-859d-4687-8d75-bdb21ceeb873 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.663445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470afd-859d-4687-8d75-bdb21ceeb873 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.664293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f732e1e-0ad5-4233-9668-719a5c03c699 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.665236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470afd-859d-4687-8d75-bdb21ceeb873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.676409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.676409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.676409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.676409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.680457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.683633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.714168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 864/1725] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:39.715388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.736299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5f470afd-859d-4687-8d75-bdb21ceeb873 None None] MFA Rules not processed for user `64c5c41465004c0a81fced6e8834a5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:39.740636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853dde0-083e-44bf-ae1a-f4f469049b80 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.741925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5f470afd-859d-4687-8d75-bdb21ceeb873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:39.752584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.753227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.753540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.754867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.755551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:39.755862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.757959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.776559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 865/1726] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:39.777847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.795713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7accf-dc9c-4e79-a682-5ece5bb54b49 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.807906 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.808822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.810756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.811138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.811910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.816820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.845567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 866/1727] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:39.847275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.850415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:39.873846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 862/1728] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:39.874768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470afd-859d-4687-8d75-bdb21ceeb873 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.905154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:39.915426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470afd-859d-4687-8d75-bdb21ceeb873 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.928912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.930100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.930387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.930767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.931559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.933440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:39.948620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 863/1729] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:39.948620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:39.967933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a50e9-65be-4ab0-8f2c-5b3df2d9bfbb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:39.982714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:39.983410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:39.984473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:39.984952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:39.985765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:39.990222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:40.054915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cf9c7-1c7e-4e43-be21-41e7c1f3df4b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:40.059422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 864/1730] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:39 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:40.060755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:40.176005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:40.177047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:40.177492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:40.177901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:40.179984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:40.219949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0476-f705-4883-9507-9f3cf1b5424e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:40.230369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:40.231201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:40.231530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:40.231912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:40.233209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:40.238111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:40.261978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 865/1731] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:40.263081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:40.265081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:40.317549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:40.349636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:40.352033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:40.353308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79a15-ba23-4034-873a-68f0ae4ad554 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:40.357918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:40.358797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:40.359084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:40.359352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:40.369331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:40.371143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:40.382422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 866/1732] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:40.382422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:40.391423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 867/1733] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:40.393828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:40.413155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d15548-a804-4fe5-bb50-2da8c887abcf service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:40.439289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:40.439289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:40.439289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:40.439289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:40.440131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:40.444319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:40.470456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04582ef-f820-4c74-a909-063142dfa485 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:40.488546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:40.489339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:40.489710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:40.490051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] PATH_INFO: `/v3/projects/cd4b959ac3e14fa3b2235fde98994379/users/fdf62766605e45c199f365b18ccbee94/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:40.493583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 868/1734] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:40 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:40.495863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:40.518449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413a3c-d0b6-456d-879a-440514bff1f9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:40.533592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0fa07-bd8e-4b7e-a10b-7008d7f6acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:40.534299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0fa07-bd8e-4b7e-a10b-7008d7f6acb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:40.536754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0fa07-bd8e-4b7e-a10b-7008d7f6acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:40.537067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0fa07-bd8e-4b7e-a10b-7008d7f6acb1 admin admin] PATH_INFO: `/v3/projects/123660f0681b4e258e7215a2523fd41c/users/7cbe300214c948e287eae7eb6310175f/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:40.548633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4b959ac3e14fa3b2235fde98994379, user_id=fdf62766605e45c199f365b18ccbee94, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:40.551582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:40.574461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0fa07-bd8e-4b7e-a10b-7008d7f6acb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=123660f0681b4e258e7215a2523fd41c, user_id=7cbe300214c948e287eae7eb6310175f, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:40.581073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0fa07-bd8e-4b7e-a10b-7008d7f6acb1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:40.583226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 867/1735] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:40 2022] PUT /identity/v3/projects/cd4b959ac3e14fa3b2235fde98994379/users/fdf62766605e45c199f365b18ccbee94/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:40.591296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:40.628299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 869/1736] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:40 2022] PUT /identity/v3/projects/123660f0681b4e258e7215a2523fd41c/users/7cbe300214c948e287eae7eb6310175f/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:40.628299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd8ee-7c96-4f07-b2b2-c77b6bcacab3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:40.628299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd8ee-7c96-4f07-b2b2-c77b6bcacab3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:40.628299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd8ee-7c96-4f07-b2b2-c77b6bcacab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:40.765213 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2f9cd8ee-7c96-4f07-b2b2-c77b6bcacab3 None None] MFA Rules not processed for user `fdf62766605e45c199f365b18ccbee94`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:40.769912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f9cd8ee-7c96-4f07-b2b2-c77b6bcacab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:40.785252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:40.858099 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c3b3-70e5-4fb5-8f03-1346c8a364c9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:41.003222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 870/1737] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:41.005179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4936ba5-caf7-48c4-b437-ca42a4db3107 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:41.037910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4936ba5-caf7-48c4-b437-ca42a4db3107 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:41.038196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4936ba5-caf7-48c4-b437-ca42a4db3107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:41.154146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6f2e-b873-41df-999d-274687aa00d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:41.154826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6f2e-b873-41df-999d-274687aa00d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:41.155112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6f2e-b873-41df-999d-274687aa00d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:41.155393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6f2e-b873-41df-999d-274687aa00d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:41.156956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe6f2e-b873-41df-999d-274687aa00d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:41.159080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe6f2e-b873-41df-999d-274687aa00d5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:41.203347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 868/1738] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 620 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:41.208467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6a22c-e331-42b0-8718-037a4b5d7619 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:41.208764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6a22c-e331-42b0-8718-037a4b5d7619 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:41.209051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6a22c-e331-42b0-8718-037a4b5d7619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:41.235987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e4936ba5-caf7-48c4-b437-ca42a4db3107 None None] MFA Rules not processed for user `7cbe300214c948e287eae7eb6310175f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:41.241402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e4936ba5-caf7-48c4-b437-ca42a4db3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:41.321086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-96c6a22c-e331-42b0-8718-037a4b5d7619 None None] MFA Rules not processed for user `d91359eb2ecb4b7391f579732a596602`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:41.322296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-96c6a22c-e331-42b0-8718-037a4b5d7619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:41.425145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 871/1739] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:41.426141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4936ba5-caf7-48c4-b437-ca42a4db3107 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:41.448424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4936ba5-caf7-48c4-b437-ca42a4db3107 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:41.470454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:41.473259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:41.473714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:41.473991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:41.484639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:41.486822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:41.527626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 869/1740] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:41.527626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6a22c-e331-42b0-8718-037a4b5d7619 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:41.530129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:41.565728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 872/1741] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:41 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:41.566565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:41.572656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6a22c-e331-42b0-8718-037a4b5d7619 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:41.574646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:41.714595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:41.715849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:41.716130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:41.716399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:41.717073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:41.718751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:41.733213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 870/1742] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:41.733213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:41.739518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282cb6-ddea-45ac-8291-a16972222463 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:41.760783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:41.761499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:41.761787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:41.762069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] PATH_INFO: `/v3/users/c5a43d7fe5344a0383dc058a29454a4e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:41.763439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a43d7fe5344a0383dc058a29454a4e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:41.765891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:41.767864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0834088-1f0a-40db-bbb6-db29122a25bb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:41.781216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:41.782634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:41.783078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:41.783503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:41.791310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:41.796818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:41.884407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a43d7fe5344a0383dc058a29454a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:41.901318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a43d7fe5344a0383dc058a29454a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:41.926987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a43d7fe5344a0383dc058a29454a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:41.929527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a43d7fe5344a0383dc058a29454a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:41.931482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 871/1743] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:41 2022] POST /identity/v3/projects => generated 405 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:41.935868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a43d7fe5344a0383dc058a29454a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:41.946079 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:41.952516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:41.983715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 873/1744] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:41 2022] DELETE /identity/v3/users/c5a43d7fe5344a0383dc058a29454a4e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:41.988047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:41.992543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:41.997125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:42.185285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91141b-aa2a-4217-b457-bfbabf463349 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:42.193633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb4c0-07d9-4cae-896a-39dfb0cb7b38 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:42.198295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:42.199001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.199291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.199567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.201545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:42.203849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:42.205657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.206012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:42.206737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.207014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] PATH_INFO: `/v3/users/83969c75a68c44219c4d5ae9c3bf4f52` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.211695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83969c75a68c44219c4d5ae9c3bf4f52)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:42.217190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:42.254542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 874/1745] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:41 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:42.255791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:42.259385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:42.280557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:42.291039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b02030-8755-4e8a-916f-0f92f232be10 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:42.301922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:42.302806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.303464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.304524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] PATH_INFO: `/v3/projects/35861acc905e45aab3d590b2bd8a444d/users/c8e066893b934342bb3405514c851667/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.349737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35861acc905e45aab3d590b2bd8a444d, user_id=c8e066893b934342bb3405514c851667, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:42.354139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:42.385691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 875/1746] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:42 2022] PUT /identity/v3/projects/35861acc905e45aab3d590b2bd8a444d/users/c8e066893b934342bb3405514c851667/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:42.393696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:42.408829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83969c75a68c44219c4d5ae9c3bf4f52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:42.410287 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:42.427806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83969c75a68c44219c4d5ae9c3bf4f52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:42.429004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83969c75a68c44219c4d5ae9c3bf4f52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:42.453033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83969c75a68c44219c4d5ae9c3bf4f52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:42.454096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dd7c47cc-b613-49ce-89fc-3a5b5c694238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83969c75a68c44219c4d5ae9c3bf4f52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:42.492632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 872/1747] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:41 2022] DELETE /identity/v3/users/83969c75a68c44219c4d5ae9c3bf4f52 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:42.492956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb43777-4b0c-4453-aae1-89372a2a5927 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.494572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb43777-4b0c-4453-aae1-89372a2a5927 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.494572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb43777-4b0c-4453-aae1-89372a2a5927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.538036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ecb43777-4b0c-4453-aae1-89372a2a5927 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:42.542590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ecb43777-4b0c-4453-aae1-89372a2a5927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:42.589536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed352-faea-45a3-89bd-0012434287d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:42.744532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 873/1748] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:42.745765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfa7-ff06-4681-90bc-0a9bc8d836d7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.746048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfa7-ff06-4681-90bc-0a9bc8d836d7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.746318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfa7-ff06-4681-90bc-0a9bc8d836d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.756565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:42.757451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.759081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.759488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.760272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:42.767082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:42.811255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 876/1749] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:42 2022] POST /identity/v3/users => generated 309 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:42.814638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:42.817449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:42.841309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23832f4-1490-45ae-b365-51688cff818a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:42.848965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be7d54-93c6-481d-9568-698cba0b3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:42.850277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be7d54-93c6-481d-9568-698cba0b3600 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.850649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be7d54-93c6-481d-9568-698cba0b3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.851086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be7d54-93c6-481d-9568-698cba0b3600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.852100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be7d54-93c6-481d-9568-698cba0b3600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:42.870140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be7d54-93c6-481d-9568-698cba0b3600 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:42.889147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 877/1750] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:42.891264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:42.892061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:42.892648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:42.892923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:42.966478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a9fdcfa7-ff06-4681-90bc-0a9bc8d836d7 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:42.971014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9fdcfa7-ff06-4681-90bc-0a9bc8d836d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:43.000131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] MFA Rules not processed for user `c8e066893b934342bb3405514c851667`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:43.004017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:43.181577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 874/1751] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:43.183788 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:43.184890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:43.185350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:43.217606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:43.270922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 878/1752] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:43.271890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:43.274572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:43.286512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:43.289054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:43.299144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 875/1753] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:43.300212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:43.303697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:43.338658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7a9b8-9f13-49dc-9641-f3af3135021b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:43.349405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:43.350076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:43.350357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:43.350629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:43.351290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:43.359607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:43.382458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 879/1754] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:43.382458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:43.405874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad04af-f34f-46ce-ac32-86c2cffd21d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:43.423827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:43.424536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:43.424814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:43.425087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] PATH_INFO: `/v3/projects/aaf857815ba3446e88e8710243054075/users/9d40b5021615492aad861ba222b41b42/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:43.456668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7583c-6003-454b-9789-d7e884da02af None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:43.465358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:43.466050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:43.466333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:43.466611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:43.488536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf857815ba3446e88e8710243054075, user_id=9d40b5021615492aad861ba222b41b42, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:43.488889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:43.490399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:43.493950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:43.515136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 876/1755] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:43.516484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:43.520596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:43.526887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 880/1756] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:43 2022] PUT /identity/v3/projects/aaf857815ba3446e88e8710243054075/users/9d40b5021615492aad861ba222b41b42/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:43.526887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:43.568967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9eaf3-0c01-4b38-904c-b7194d155eb1 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:43.731901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:43.732211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:43.732499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:43.732776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:43.733441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:43.735385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:43.753597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a7c3a-0fb6-4733-868b-1a60a4895ca6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:43.771821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:43.775216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:43.777326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:43.777326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] PATH_INFO: `/v3/projects/9a08cfd8d7a94f17858e1d5a7b70231d/users/4bb9afebbd904e0b83d6bc6bb90e331e/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:43.800354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 877/1757] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:43 2022] POST /identity/v3/projects => generated 365 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:43.802775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:43.823241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a08cfd8d7a94f17858e1d5a7b70231d, user_id=4bb9afebbd904e0b83d6bc6bb90e331e, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:43.830326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:43.857079 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:43.866223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 881/1758] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:43 2022] PUT /identity/v3/projects/9a08cfd8d7a94f17858e1d5a7b70231d/users/4bb9afebbd904e0b83d6bc6bb90e331e/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:43.869124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:43.939551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e6c9-9d37-496e-98b2-38b07d742d69 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.035520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce5c3-eb3a-4d68-9d48-8451d83c9006 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.051729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.052373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.052648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.053096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.053934 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.055152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.055783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.056225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.057087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.066570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.067285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.072057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.093821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 882/1759] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:44.093821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:44.095023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 878/1760] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:44.096085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:44.099917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:44.109470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed5ae-30d5-4d35-a34d-8a1234c4a566 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.116059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.117015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.117143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.117436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.118427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.120677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.175067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 879/1761] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:44 2022] POST /identity/v3/users => generated 289 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:44.177902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:44.201677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:44.207923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4465-c3a7-48af-a1f4-3afab8514d2b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.228045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad4b4-690f-4d7f-b2ad-4778071da152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.228745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad4b4-690f-4d7f-b2ad-4778071da152 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.229815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad4b4-690f-4d7f-b2ad-4778071da152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.230095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad4b4-690f-4d7f-b2ad-4778071da152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.231134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ad4b4-690f-4d7f-b2ad-4778071da152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.242317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ad4b4-690f-4d7f-b2ad-4778071da152 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.270976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 880/1762] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:44.272689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319ec9-c45f-4257-9087-fc7f1888ce2b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.273090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319ec9-c45f-4257-9087-fc7f1888ce2b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.273862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319ec9-c45f-4257-9087-fc7f1888ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.318053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-67319ec9-c45f-4257-9087-fc7f1888ce2b None None] MFA Rules not processed for user `64c5c41465004c0a81fced6e8834a5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:44.318053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-67319ec9-c45f-4257-9087-fc7f1888ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:44.319145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536bbe-f649-4e6f-989a-7c32ddef7191 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.326550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.327313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.327639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.328007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.337062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 881/1763] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Aug 8 02:33:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:44.340039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67319ec9-c45f-4257-9087-fc7f1888ce2b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:44.376379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67319ec9-c45f-4257-9087-fc7f1888ce2b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.389633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.390407 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.390748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.391130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] PATH_INFO: `/v3/projects/aaf857815ba3446e88e8710243054075/users/9d40b5021615492aad861ba222b41b42/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.394484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf857815ba3446e88e8710243054075, user_id=9d40b5021615492aad861ba222b41b42, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.399353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.425547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 882/1764] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:44 2022] PUT /identity/v3/projects/aaf857815ba3446e88e8710243054075/users/9d40b5021615492aad861ba222b41b42/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:44.425547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:44.482331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.483942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.495388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 883/1765] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:33:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:33:44.498191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:44.516461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581009-438c-4a01-aac9-035e0102071a service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.526945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.527540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33943a-8b66-4f81-84a9-89fe5134b5eb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.528276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.528862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.529328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] PATH_INFO: `/v3/projects/9a08cfd8d7a94f17858e1d5a7b70231d/users/4bb9afebbd904e0b83d6bc6bb90e331e/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.532412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a08cfd8d7a94f17858e1d5a7b70231d, user_id=4bb9afebbd904e0b83d6bc6bb90e331e, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.535926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9d059-7ff3-4a24-a46b-ad4dd4f8d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.537437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.538608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d059-7ff3-4a24-a46b-ad4dd4f8d1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.540543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d059-7ff3-4a24-a46b-ad4dd4f8d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.540847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d059-7ff3-4a24-a46b-ad4dd4f8d1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.541728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9d059-7ff3-4a24-a46b-ad4dd4f8d1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.543392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9d059-7ff3-4a24-a46b-ad4dd4f8d1ab admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.558684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 884/1766] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:44 2022] PUT /identity/v3/projects/9a08cfd8d7a94f17858e1d5a7b70231d/users/4bb9afebbd904e0b83d6bc6bb90e331e/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:44.559888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:44.561840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:44.585534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 883/1767] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:44.590490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d1aa7-4295-47d2-b37d-07f60010f154 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.591093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d1aa7-4295-47d2-b37d-07f60010f154 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.592922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d1aa7-4295-47d2-b37d-07f60010f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.733980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2568b51-c875-47fc-a4d2-dce92c65cc79 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:44.742176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e37b7-903c-41ec-8c52-40a88854fddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:44.743049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e37b7-903c-41ec-8c52-40a88854fddd service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.743329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e37b7-903c-41ec-8c52-40a88854fddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.744096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e37b7-903c-41ec-8c52-40a88854fddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.746624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-311d1aa7-4295-47d2-b37d-07f60010f154 None None] MFA Rules not processed for user `9d40b5021615492aad861ba222b41b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:44.756026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e37b7-903c-41ec-8c52-40a88854fddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:44.756915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e37b7-903c-41ec-8c52-40a88854fddd service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:44.760368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-311d1aa7-4295-47d2-b37d-07f60010f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:44.771518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 885/1768] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:44.773385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb54c5-d34c-4354-b6fa-fc21828b6d8f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:44.774011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb54c5-d34c-4354-b6fa-fc21828b6d8f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:44.774011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb54c5-d34c-4354-b6fa-fc21828b6d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:44.827983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5aeb54c5-d34c-4354-b6fa-fc21828b6d8f None None] MFA Rules not processed for user `4bb9afebbd904e0b83d6bc6bb90e331e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:44.829785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5aeb54c5-d34c-4354-b6fa-fc21828b6d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:44.831705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:44.895470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:44.930927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 886/1769] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:44.931395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb54c5-d34c-4354-b6fa-fc21828b6d8f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:45.024757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb54c5-d34c-4354-b6fa-fc21828b6d8f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:45.032502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:45.033472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:45.033757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:45.034071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] PATH_INFO: `/v3/projects/ba437bc9851b4d67a4cf21b0e27e0291/users/868be3354bbf46ac996bc536e52684a1/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:45.057614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba437bc9851b4d67a4cf21b0e27e0291, user_id=868be3354bbf46ac996bc536e52684a1, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:45.060448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:45.093465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 887/1770] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:44 2022] PUT /identity/v3/projects/ba437bc9851b4d67a4cf21b0e27e0291/users/868be3354bbf46ac996bc536e52684a1/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:45.095006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:45.097746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:45.122927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 884/1771] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 536 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:45.129026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d1aa7-4295-47d2-b37d-07f60010f154 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:45.186749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d1aa7-4295-47d2-b37d-07f60010f154 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:45.240539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8c87e-64a3-4582-8a80-84ed99a29011 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:45.249911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:45.258060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:45.258598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:45.260096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:45.413118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:45.413973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:45.414311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:45.414933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:45.415484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:45.418911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:45.448186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:45.452214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:45.474424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 885/1772] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:45.475683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:45.485484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:45.503337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582cbb-7e1d-47a8-96dd-23fb51b3932c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:45.508747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:45.509466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:45.509751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:45.510228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:45.511388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 888/1773] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:45 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:45.512470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:45.569403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aba3f2-a96c-43c6-b4de-3e8d6f88c25c service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:45.592309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880a00-974b-4bf5-922d-1e9abc7ec8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:45.593853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880a00-974b-4bf5-922d-1e9abc7ec8af admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:45.594374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880a00-974b-4bf5-922d-1e9abc7ec8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:45.595056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880a00-974b-4bf5-922d-1e9abc7ec8af admin admin] PATH_INFO: `/v3/projects/ba437bc9851b4d67a4cf21b0e27e0291/users/868be3354bbf46ac996bc536e52684a1/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:45.609300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880a00-974b-4bf5-922d-1e9abc7ec8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba437bc9851b4d67a4cf21b0e27e0291, user_id=868be3354bbf46ac996bc536e52684a1, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:45.630874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880a00-974b-4bf5-922d-1e9abc7ec8af admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:45.649885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:45.662491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:45.666430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:45.686160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 889/1774] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:45 2022] PUT /identity/v3/projects/ba437bc9851b4d67a4cf21b0e27e0291/users/868be3354bbf46ac996bc536e52684a1/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:45.700087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893650-e093-4c80-973d-df0c6e93716f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:45.700087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893650-e093-4c80-973d-df0c6e93716f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:45.700087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893650-e093-4c80-973d-df0c6e93716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:45.748560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 886/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:45.750815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:45.777178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f80e3-e265-426c-b560-d2491860eb8e service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:45.823564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-02893650-e093-4c80-973d-df0c6e93716f None None] MFA Rules not processed for user `868be3354bbf46ac996bc536e52684a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:45.826227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02893650-e093-4c80-973d-df0c6e93716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:45.923117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:45.979530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:45.980520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:45.986482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:45.986888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] PATH_INFO: `/v3/users/7cbe300214c948e287eae7eb6310175f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:45.988506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbe300214c948e287eae7eb6310175f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:45.991704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:46.005442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 890/1776] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:46.014102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02893650-e093-4c80-973d-df0c6e93716f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:46.180420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbe300214c948e287eae7eb6310175f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:46.190771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02893650-e093-4c80-973d-df0c6e93716f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:46.206891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373bb86-7388-4c8c-ad4e-56e04cf9466a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:46.208743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373bb86-7388-4c8c-ad4e-56e04cf9466a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:46.209033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373bb86-7388-4c8c-ad4e-56e04cf9466a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:46.209347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373bb86-7388-4c8c-ad4e-56e04cf9466a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:46.231817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbe300214c948e287eae7eb6310175f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:46.233151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbe300214c948e287eae7eb6310175f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:46.242569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373bb86-7388-4c8c-ad4e-56e04cf9466a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:46.249563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373bb86-7388-4c8c-ad4e-56e04cf9466a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:46.284085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbe300214c948e287eae7eb6310175f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:46.286012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 891/1777] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:46.289837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbe300214c948e287eae7eb6310175f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:46.324307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 887/1778] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:45 2022] DELETE /identity/v3/users/7cbe300214c948e287eae7eb6310175f => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:46.330075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:46.330408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:46.331735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:46.383133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:46.387650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:46.578104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 892/1779] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:46.714080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:46.715639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:46.879250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca4cc9-227c-45ec-af7b-704aba06f52f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:46.886109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:46.886984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:46.887637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:46.888347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:46.922665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:46.928088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:46.954868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 888/1780] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:47.224627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:47.235071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:47.256823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cd54f-c86d-46f3-aae5-5a612f59c5ae None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:47.276542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:47.277488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:47.278401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:47.278401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] PATH_INFO: `/v3/projects/7aeeb2494e664c82a21d559aac27d5e3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:47.281594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aeeb2494e664c82a21d559aac27d5e3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:47.283660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:47.353407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:47.408130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:47.409890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:47.428766 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c754-34bc-49d6-bebc-27e04809619b service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:47.430324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aeeb2494e664c82a21d559aac27d5e3', 'request_id': 'req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.452217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aeeb2494e664c82a21d559aac27d5e3', 'request_id': 'req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.464970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aeeb2494e664c82a21d559aac27d5e3', 'request_id': 'req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.485318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] The token cache is being invalidate because project 7aeeb2494e664c82a21d559aac27d5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:47.485626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.487084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.490386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 893/1781] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:47 2022] DELETE /identity/v3/projects/7aeeb2494e664c82a21d559aac27d5e3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:47.497039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:47.499319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:47.551068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:47.552331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:47.552850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:47.553309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] PATH_INFO: `/v3/users/c8e066893b934342bb3405514c851667` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:47.554914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e066893b934342bb3405514c851667)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:47.585143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:47.594408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:47.680719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e32f2-3240-41d8-adcf-8c0c7f47e1c0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:47.700286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:47.700955 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:47.701233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:47.701530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] PATH_INFO: `/v3/users/e458a6fb6bd649669474ff1c8e51c143` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:47.703496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e458a6fb6bd649669474ff1c8e51c143)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:47.705460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:47.708871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e066893b934342bb3405514c851667'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.722714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e066893b934342bb3405514c851667'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.723419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e066893b934342bb3405514c851667'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.744970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e066893b934342bb3405514c851667'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.751680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-322afed0-fec5-44ca-83c2-5e1b8bb8f955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e066893b934342bb3405514c851667'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.780009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 889/1782] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:47 2022] DELETE /identity/v3/users/c8e066893b934342bb3405514c851667 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:47.790260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:47.790667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:47.791404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:47.815995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e458a6fb6bd649669474ff1c8e51c143'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.837952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e458a6fb6bd649669474ff1c8e51c143'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.848925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:47.850204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:47.874100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e458a6fb6bd649669474ff1c8e51c143'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.874978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e458a6fb6bd649669474ff1c8e51c143'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.876554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e458a6fb6bd649669474ff1c8e51c143'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:47.928258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 894/1783] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:47 2022] DELETE /identity/v3/users/e458a6fb6bd649669474ff1c8e51c143 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:48.010203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:48.012267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:48.028392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 890/1784] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:48.102479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:48.158452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:48.160434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:48.203659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa17c-566f-4f76-a92f-e414254a01ca admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:48.221794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:48.223327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:48.223856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:48.224148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] PATH_INFO: `/v3/projects/cd21ccfee6c74336bad3b1503e868bc2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:48.229767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd21ccfee6c74336bad3b1503e868bc2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:48.238697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:48.356700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6032bad-8fbb-4e10-8d87-37a5442ca539 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:48.408020 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd21ccfee6c74336bad3b1503e868bc2', 'request_id': 'req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:48.429748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd21ccfee6c74336bad3b1503e868bc2', 'request_id': 'req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:48.474435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd21ccfee6c74336bad3b1503e868bc2', 'request_id': 'req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:48.501493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:48.506497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] The token cache is being invalidate because project cd21ccfee6c74336bad3b1503e868bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:48.506801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:48.507803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f51f8e22-b484-4f0f-89cc-fb8caf12ce8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:48.513332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 895/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:48 2022] DELETE /identity/v3/projects/cd21ccfee6c74336bad3b1503e868bc2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:33:48.514720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67baf-bf38-49af-a707-1bb38f445a4f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:48.515055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67baf-bf38-49af-a707-1bb38f445a4f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:48.515279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67baf-bf38-49af-a707-1bb38f445a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:48.556502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb245bb-ec7c-4611-b5e3-5c7c856b3bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:48.558743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb245bb-ec7c-4611-b5e3-5c7c856b3bda service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:48.559765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb245bb-ec7c-4611-b5e3-5c7c856b3bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:48.560727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-74b67baf-bf38-49af-a707-1bb38f445a4f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:48.560840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb245bb-ec7c-4611-b5e3-5c7c856b3bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:48.564461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ccb245bb-ec7c-4611-b5e3-5c7c856b3bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:48.571054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74b67baf-bf38-49af-a707-1bb38f445a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:48.733681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb245bb-ec7c-4611-b5e3-5c7c856b3bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:48.735887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb245bb-ec7c-4611-b5e3-5c7c856b3bda service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:48.766142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 891/1786] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:48.823259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 896/1787] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:48.830918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:48.831320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:48.831651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:48.888424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:48.891767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:48.919131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 892/1788] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:48.925406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67baf-bf38-49af-a707-1bb38f445a4f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:48.957925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67baf-bf38-49af-a707-1bb38f445a4f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:48.976498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:48.977265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:48.979731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:48.980122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:48.982690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:48.983245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:48.985636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:48.987349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:49.002412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:49.015667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2d3bc-5b4b-4d31-b1f5-9c4128bf1591 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:49.035056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:49.037993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.038468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.039483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] PATH_INFO: `/v3/users/fdf62766605e45c199f365b18ccbee94` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.043728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 897/1789] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:49.044117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf62766605e45c199f365b18ccbee94)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:49.044904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:49.053013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:49.057549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50433393-c4b8-4445-9663-7661a8953ee4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:49.085020 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:49.086288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.086965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.102889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.107903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:49.115132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:49.190277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 898/1790] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:49 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:49.191510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:49.191833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf62766605e45c199f365b18ccbee94'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:49.218138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf62766605e45c199f365b18ccbee94'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:49.218995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf62766605e45c199f365b18ccbee94'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:49.237025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:49.280929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf62766605e45c199f365b18ccbee94'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:49.282497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc50438e-08ec-4c26-ab08-f5438aa4d7eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf62766605e45c199f365b18ccbee94'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:49.315435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d224fc-2016-47fa-a01f-2fa9863f095c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:49.318322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 893/1791] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:48 2022] DELETE /identity/v3/users/fdf62766605e45c199f365b18ccbee94 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:33:49.324405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b5dd-f385-4de1-af0d-ef08e12d42c8 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.325575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b5dd-f385-4de1-af0d-ef08e12d42c8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.325862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b5dd-f385-4de1-af0d-ef08e12d42c8 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.327596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 894/1792] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:33:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:49.328765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487732-d115-4b1c-bb78-f707b9803ec5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.329049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487732-d115-4b1c-bb78-f707b9803ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.329323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487732-d115-4b1c-bb78-f707b9803ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.376662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cb487732-d115-4b1c-bb78-f707b9803ec5 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:49.378141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cb487732-d115-4b1c-bb78-f707b9803ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:49.480543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:49.506268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 895/1793] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:49.572677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:49.572677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.572677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.572677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.574689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:49.576167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:49.625053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e124-2b02-4e94-810c-ed7f7d54cd08 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.625630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e124-2b02-4e94-810c-ed7f7d54cd08 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.626068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e124-2b02-4e94-810c-ed7f7d54cd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.630354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 899/1794] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:49 2022] POST /identity/v3/users => generated 279 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:49.635193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:49.637453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:49.659489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd88b-f1d3-4d48-95b1-d607341646dc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:49.669201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4529e124-2b02-4e94-810c-ed7f7d54cd08 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:49.670314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:49.671447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.671743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.672033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.672682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:49.674335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:49.676549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4529e124-2b02-4e94-810c-ed7f7d54cd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:49.696207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 900/1795] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:33:49.700239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:49.722673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ca96-8234-4b60-b386-3fe779a5c7a8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:49.728728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:49.729551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.729949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.730317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.731176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:49.732831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:49.756069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 901/1796] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:49.761247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:49.796401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9836-72f8-4548-899e-d468fd7adbe8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:49.813547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:49.815399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.816847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.817512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] PATH_INFO: `/v3/projects/e405b4cd4a544e8fa6680fca3703f5fb/users/fa535e7f715a4c6c986e2804701d76a2/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.867135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e405b4cd4a544e8fa6680fca3703f5fb, user_id=fa535e7f715a4c6c986e2804701d76a2, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:49.876632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:49.887483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 896/1797] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:33:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:49.911990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 902/1798] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:49 2022] PUT /identity/v3/projects/e405b4cd4a544e8fa6680fca3703f5fb/users/fa535e7f715a4c6c986e2804701d76a2/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:49.928276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb858-c18b-4974-be58-a3583e11aa90 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:49.928709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb858-c18b-4974-be58-a3583e11aa90 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:49.929231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb858-c18b-4974-be58-a3583e11aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:49.998956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:50.001192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:50.045615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-675fb858-c18b-4974-be58-a3583e11aa90 None None] MFA Rules not processed for user `fa535e7f715a4c6c986e2804701d76a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:50.051355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-675fb858-c18b-4974-be58-a3583e11aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:50.168634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff96-fd43-4f99-9f4e-05d933fc771c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:50.173721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:50.174446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:50.174728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:50.174996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:50.211885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:50.239963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 897/1799] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:50.244975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fb858-c18b-4974-be58-a3583e11aa90 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:50.279730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:50.281721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:50.332936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 903/1800] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:50.364991 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fb858-c18b-4974-be58-a3583e11aa90 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:50.376596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:50.377406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:50.377833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:50.379060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:50.382049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:50.384334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:50.462981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 898/1801] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:50 2022] POST /identity/v3/projects => generated 357 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:33:50.467716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:50.488008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba1ed-3bac-4a96-ac12-565e6818aeca service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:50.609874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:50.610533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:50.610812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:50.611144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:50.612227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:50.633304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:50.672608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 904/1802] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:50 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:33:50.673589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:50.680548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:50.686693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9347c9-6dd5-4e29-94a4-b6f57d9085f6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:50.698152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:50.699120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:50.699551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:50.699876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:50.733481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:50.736858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:50.758220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 899/1803] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:50.759273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:50.783531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e46eb-ecf2-4381-b7c1-e945dbb546e8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:50.790393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:50.791142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:50.791424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:50.791728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] PATH_INFO: `/v3/projects/4fbb06782d6c43698700e2682c9da6b7/users/9991df1c8c4d4e0a91e0f8b3ed732234/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:50.830508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbb06782d6c43698700e2682c9da6b7, user_id=9991df1c8c4d4e0a91e0f8b3ed732234, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:50.838169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:50.875513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 905/1804] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:50 2022] PUT /identity/v3/projects/4fbb06782d6c43698700e2682c9da6b7/users/9991df1c8c4d4e0a91e0f8b3ed732234/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:50.876431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:50.892478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889624c1-4653-40b9-b6a5-7fc37ef0c0e8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:51.045011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:51.047678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:51.048164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:51.049144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:51.050786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:51.054830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:51.063203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:51.066417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:51.098379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 900/1805] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:51.104757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:51.136477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27891a8f-4683-4f6b-a99d-16e055f4708d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:51.154217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2dc5-365c-43ab-a94f-8c44302f0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:51.155615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2dc5-365c-43ab-a94f-8c44302f0332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:51.156219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2dc5-365c-43ab-a94f-8c44302f0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:51.156887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2dc5-365c-43ab-a94f-8c44302f0332 admin admin] PATH_INFO: `/v3/projects/4fbb06782d6c43698700e2682c9da6b7/users/9991df1c8c4d4e0a91e0f8b3ed732234/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:51.171046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2dc5-365c-43ab-a94f-8c44302f0332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbb06782d6c43698700e2682c9da6b7, user_id=9991df1c8c4d4e0a91e0f8b3ed732234, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:51.174517 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2dc5-365c-43ab-a94f-8c44302f0332 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:51.203687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 901/1806] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:51 2022] PUT /identity/v3/projects/4fbb06782d6c43698700e2682c9da6b7/users/9991df1c8c4d4e0a91e0f8b3ed732234/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:33:51.219345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:51.219984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:51.220474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:51.295722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] MFA Rules not processed for user `9991df1c8c4d4e0a91e0f8b3ed732234`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:51.297096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:51.313051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0997e-1b54-451a-a387-61360b8df808 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:51.382860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:51.463684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:51.465138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:51.466424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:51.467386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:51.497781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:51.503516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:51.521146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 902/1807] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:51.540517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 906/1808] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:33:51.548742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:51.550867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:51.641232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:51.645783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:51.714856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13e60-622f-4037-8ebf-b1bb22bd7333 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:51.723468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:51.724477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:51.725268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:51.725449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:51.764792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:51.766762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:51.813970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 903/1809] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:51.814596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7c72e-d308-40a1-9e17-f63fb0d6d168 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:51.827686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:51.828360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:51.828640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:51.828963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] PATH_INFO: `/v3/projects/cd4b959ac3e14fa3b2235fde98994379` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:51.837068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4b959ac3e14fa3b2235fde98994379)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:51.839107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:51.899452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:51.902582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:51.918004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:51.954012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af5455-f22a-46c0-bd1c-63b8fe75ddda service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:52.021433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4b959ac3e14fa3b2235fde98994379', 'request_id': 'req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.050527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4b959ac3e14fa3b2235fde98994379', 'request_id': 'req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.088052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4b959ac3e14fa3b2235fde98994379', 'request_id': 'req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.114915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] The token cache is being invalidate because project cd4b959ac3e14fa3b2235fde98994379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:52.115782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.118538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.122321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 907/1810] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:51 2022] DELETE /identity/v3/projects/cd4b959ac3e14fa3b2235fde98994379 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:52.123216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:52.128100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:52.154534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:52.156049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:52.156049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:52.156049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] PATH_INFO: `/v3/projects/123660f0681b4e258e7215a2523fd41c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:52.164621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=123660f0681b4e258e7215a2523fd41c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:52.167721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:52.274387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:52.324868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7c584-8f7f-4a22-b651-2c87a1585ec8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:52.345816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123660f0681b4e258e7215a2523fd41c', 'request_id': 'req-049d20ae-509f-4091-a01d-394216192e0d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.374684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123660f0681b4e258e7215a2523fd41c', 'request_id': 'req-049d20ae-509f-4091-a01d-394216192e0d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.399698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123660f0681b4e258e7215a2523fd41c', 'request_id': 'req-049d20ae-509f-4091-a01d-394216192e0d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.434069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] The token cache is being invalidate because project 123660f0681b4e258e7215a2523fd41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:52.434970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.438560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.443692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 904/1811] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:51 2022] DELETE /identity/v3/projects/123660f0681b4e258e7215a2523fd41c => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:52.451448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:52.457559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:52.497513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:52.498992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:52.500128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:52.503399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:52.510446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:52.635118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d20ae-509f-4091-a01d-394216192e0d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:52.647578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:52.650284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:52.651141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:52.651981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] PATH_INFO: `/v3/users/9d40b5021615492aad861ba222b41b42` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:52.652905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:52.654697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d40b5021615492aad861ba222b41b42)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:52.657802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:52.660717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:52.682173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 908/1812] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:52.683087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:52.685778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:52.732478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee93863-3af2-4d45-bc3c-99e987ee3803 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:52.747276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:52.755074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:52.755828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:52.756110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:52.756378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] PATH_INFO: `/v3/users/4bb9afebbd904e0b83d6bc6bb90e331e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:52.760881 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d40b5021615492aad861ba222b41b42'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.762594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb9afebbd904e0b83d6bc6bb90e331e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:52.764605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:52.774527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d40b5021615492aad861ba222b41b42'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.775599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d40b5021615492aad861ba222b41b42'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.796872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d40b5021615492aad861ba222b41b42'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.797977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d40b5021615492aad861ba222b41b42'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.817026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 905/1813] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:52 2022] DELETE /identity/v3/users/9d40b5021615492aad861ba222b41b42 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:52.819354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:52.822642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:52.891994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb9afebbd904e0b83d6bc6bb90e331e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.916149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb9afebbd904e0b83d6bc6bb90e331e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.948109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb9afebbd904e0b83d6bc6bb90e331e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.948956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb9afebbd904e0b83d6bc6bb90e331e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.949614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f968327-07ae-4fdf-a4a9-0255a86561b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb9afebbd904e0b83d6bc6bb90e331e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:52.994186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 909/1814] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:52 2022] DELETE /identity/v3/users/4bb9afebbd904e0b83d6bc6bb90e331e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:52.994186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade25c-3ab8-4dbc-9a7e-b72e2285a260 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:52.994186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade25c-3ab8-4dbc-9a7e-b72e2285a260 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:52.994186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade25c-3ab8-4dbc-9a7e-b72e2285a260 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:52.996796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 910/1815] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:33:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:33:53.026818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bfa4-e9ca-49ee-bfad-b7f19c5f0144 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:53.128324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:53.129119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:53.129527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:53.130032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] PATH_INFO: `/v3/projects/35861acc905e45aab3d590b2bd8a444d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:53.131303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35861acc905e45aab3d590b2bd8a444d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:53.133466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:53.144390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:53.144965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:53.146307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:53.208585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:53.211226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:53.211591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35861acc905e45aab3d590b2bd8a444d', 'request_id': 'req-ebf9cfa7-13e3-4761-b64a-546c270a6196'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.220158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35861acc905e45aab3d590b2bd8a444d', 'request_id': 'req-ebf9cfa7-13e3-4761-b64a-546c270a6196'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.233543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35861acc905e45aab3d590b2bd8a444d', 'request_id': 'req-ebf9cfa7-13e3-4761-b64a-546c270a6196'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.235433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:53.243166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:53.258608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] The token cache is being invalidate because project 35861acc905e45aab3d590b2bd8a444d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:53.259148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.260158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.266213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 906/1816] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:52 2022] DELETE /identity/v3/projects/35861acc905e45aab3d590b2bd8a444d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:53.270727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:53.272995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:53.357205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 911/1817] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:33:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:53.358544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:53.360372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:53.520861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663d29d-771e-46fa-8f68-96f8c455ee21 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:53.526311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:53.527265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:53.527862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:53.528355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] PATH_INFO: `/v3/projects/6d09d9ab26fe460e8b04c27201a1d94f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:53.529835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d09d9ab26fe460e8b04c27201a1d94f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:53.530340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9cfa7-13e3-4761-b64a-546c270a6196 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:53.537661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:53.538348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:53.538793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:53.539805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] PATH_INFO: `/v3/users/868be3354bbf46ac996bc536e52684a1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:53.541154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=868be3354bbf46ac996bc536e52684a1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:53.543240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:53.554274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:53.691334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868be3354bbf46ac996bc536e52684a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.693078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d09d9ab26fe460e8b04c27201a1d94f', 'request_id': 'req-b96dc3b3-8f91-438b-96a6-8e289bb72486'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.705557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868be3354bbf46ac996bc536e52684a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.705879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d09d9ab26fe460e8b04c27201a1d94f', 'request_id': 'req-b96dc3b3-8f91-438b-96a6-8e289bb72486'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.706550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868be3354bbf46ac996bc536e52684a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.718190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d09d9ab26fe460e8b04c27201a1d94f', 'request_id': 'req-b96dc3b3-8f91-438b-96a6-8e289bb72486'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.727459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868be3354bbf46ac996bc536e52684a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.728891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f8450e87-aaab-4bb4-85b3-6969426080ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868be3354bbf46ac996bc536e52684a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.737784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] The token cache is being invalidate because project 6d09d9ab26fe460e8b04c27201a1d94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:53.738077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.738835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:53.746036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 912/1818] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:53 2022] DELETE /identity/v3/projects/6d09d9ab26fe460e8b04c27201a1d94f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:53.747894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:53.750886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:53.755882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 907/1819] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:53 2022] DELETE /identity/v3/users/868be3354bbf46ac996bc536e52684a1 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:53.760136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77b19-869c-49ed-bcbc-685ee703ff00 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:53.760136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77b19-869c-49ed-bcbc-685ee703ff00 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:53.760136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77b19-869c-49ed-bcbc-685ee703ff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:53.785759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-74d77b19-869c-49ed-bcbc-685ee703ff00 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:53.787362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-74d77b19-869c-49ed-bcbc-685ee703ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:53.830754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:53.889631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc3b3-8f91-438b-96a6-8e289bb72486 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:53.971004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 908/1820] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:53.973199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefc3a-bab5-4ca8-813b-85572b2b6611 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:53.973520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefc3a-bab5-4ca8-813b-85572b2b6611 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:53.973853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefc3a-bab5-4ca8-813b-85572b2b6611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.006206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-22eefc3a-bab5-4ca8-813b-85572b2b6611 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:54.009498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-22eefc3a-bab5-4ca8-813b-85572b2b6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:54.027843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 909/1821] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:54.034364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefc3a-bab5-4ca8-813b-85572b2b6611 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:54.052189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:54.071789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:54.072568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.073037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.073439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.075614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:54.106648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:54.107809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefc3a-bab5-4ca8-813b-85572b2b6611 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:54.111269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:54.124019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:54.125354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.125693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.126156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.127811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:54.135685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:54.139480 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:54.165450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 910/1822] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:54.170569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:54.178239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 913/1823] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:54.203472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74622c-7593-41c0-9cfd-41d52d530e26 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:54.211714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:54.213396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.213714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.214331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.215152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:54.218287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:54.285681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 911/1824] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:54 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:33:54.287211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:54.315071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b95c4f-b052-4393-ba09-8239b78fc7a5 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:54.481788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:54.483080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.483080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.483491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.484122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:54.493488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:54.561969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 914/1825] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:54 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:54.566435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:54.639353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f39c7-8913-4861-9d28-7bca651bdd24 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:54.657471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:54.659619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.660417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.663128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.666529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:54.673700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:54.708104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 912/1826] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:54.714345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:54.727349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cedf1-e2a7-4234-ba9c-f833e9b3727b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:54.740368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a01f2-970c-4de5-8c85-4abe2a20cecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:54.741740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a01f2-970c-4de5-8c85-4abe2a20cecc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.742103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a01f2-970c-4de5-8c85-4abe2a20cecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.742880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a01f2-970c-4de5-8c85-4abe2a20cecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.743109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a01f2-970c-4de5-8c85-4abe2a20cecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:54.767326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a01f2-970c-4de5-8c85-4abe2a20cecc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:54.803437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 915/1827] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:54.807880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:54.825271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f910f5-43ce-4677-a230-1acf78105798 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:54.864372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:54.865720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.867260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.867776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] PATH_INFO: `/v3/projects/881623448d0b4501927e30d86b59b6be/users/0b8802d2e5ae4757a1de4c8370c0bab1/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.921823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=881623448d0b4501927e30d86b59b6be, user_id=0b8802d2e5ae4757a1de4c8370c0bab1, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:54.924827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:54.979019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:54.979558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:54.980035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:54.987820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 913/1828] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:54 2022] PUT /identity/v3/projects/881623448d0b4501927e30d86b59b6be/users/0b8802d2e5ae4757a1de4c8370c0bab1/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:33:55.057421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] MFA Rules not processed for user `0b8802d2e5ae4757a1de4c8370c0bab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:55.058399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:55.126026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:55.208733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:55.210983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 916/1829] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:55.382298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:55.384971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:55.423471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1717e-6ee6-45f4-a011-ac1671f8f01a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:55.432896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:55.433883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:55.434375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:55.434767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:55.435770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:55.474655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:55.535767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81179d-faa8-4b65-9f99-448af0459f9c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:55.547222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:55.548782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:55.549689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:55.550038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] PATH_INFO: `/v3/projects/aaf857815ba3446e88e8710243054075` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:55.552257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf857815ba3446e88e8710243054075)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:55.555893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:55.564127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 914/1830] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:55 2022] POST /identity/v3/projects => generated 387 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:55.564996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:55.573751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:55.686863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf857815ba3446e88e8710243054075', 'request_id': 'req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:55.699156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf857815ba3446e88e8710243054075', 'request_id': 'req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:55.724541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf857815ba3446e88e8710243054075', 'request_id': 'req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:55.748512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] The token cache is being invalidate because project aaf857815ba3446e88e8710243054075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:55.748923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:55.752996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:55.761671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 917/1831] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:55 2022] DELETE /identity/v3/projects/aaf857815ba3446e88e8710243054075 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:55.763301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:55.768196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:55.770556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b4a7-4a89-407f-b435-83530fa1ad9a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:55.813141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:55.853063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:55.853924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:55.854136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:55.854357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] PATH_INFO: `/v3/projects/9a08cfd8d7a94f17858e1d5a7b70231d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:55.856260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a08cfd8d7a94f17858e1d5a7b70231d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:55.860597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:55.924693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e07db9-0d24-4e32-b0b0-b2665d0fbb0d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:55.938298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa66fb-ecdd-442e-bbdc-1706f334b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:55.939487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa66fb-ecdd-442e-bbdc-1706f334b4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:55.940412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa66fb-ecdd-442e-bbdc-1706f334b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:55.940628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa66fb-ecdd-442e-bbdc-1706f334b4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:55.942344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa66fb-ecdd-442e-bbdc-1706f334b4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:55.950830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa66fb-ecdd-442e-bbdc-1706f334b4c0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:55.972799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a08cfd8d7a94f17858e1d5a7b70231d', 'request_id': 'req-bd08a561-a8dd-4ce2-b255-e98d3cb16128'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:55.987700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a08cfd8d7a94f17858e1d5a7b70231d', 'request_id': 'req-bd08a561-a8dd-4ce2-b255-e98d3cb16128'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:55.997477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:56.006073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 918/1832] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:55 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:56.011045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ffd56-5eb7-48a7-a45d-ddbfd4323aa7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.011045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ffd56-5eb7-48a7-a45d-ddbfd4323aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.011045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ffd56-5eb7-48a7-a45d-ddbfd4323aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.015302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a08cfd8d7a94f17858e1d5a7b70231d', 'request_id': 'req-bd08a561-a8dd-4ce2-b255-e98d3cb16128'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.038148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] The token cache is being invalidate because project 9a08cfd8d7a94f17858e1d5a7b70231d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:56.039574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.039574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.044718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 915/1833] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:55 2022] DELETE /identity/v3/projects/9a08cfd8d7a94f17858e1d5a7b70231d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:56.047143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.051435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.064815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-849ffd56-5eb7-48a7-a45d-ddbfd4323aa7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:56.070335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-849ffd56-5eb7-48a7-a45d-ddbfd4323aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.215026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a561-a8dd-4ce2-b255-e98d3cb16128 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.227373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d015-1436-4015-9b72-422eccfd6edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.228219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 919/1834] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:56.230512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eece166-4e29-42d7-8f18-2269c7d09724 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.231233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d015-1436-4015-9b72-422eccfd6edf admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.231826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d015-1436-4015-9b72-422eccfd6edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.232175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d015-1436-4015-9b72-422eccfd6edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.232641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eece166-4e29-42d7-8f18-2269c7d09724 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.233568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eece166-4e29-42d7-8f18-2269c7d09724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.233915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d015-1436-4015-9b72-422eccfd6edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.238195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d015-1436-4015-9b72-422eccfd6edf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.290376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 916/1835] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:56.292136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a2d5-8acb-4a24-bbdb-d7bf0f78a815 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.294585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a2d5-8acb-4a24-bbdb-d7bf0f78a815 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.294938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a2d5-8acb-4a24-bbdb-d7bf0f78a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.313434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7eece166-4e29-42d7-8f18-2269c7d09724 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:56.315861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7eece166-4e29-42d7-8f18-2269c7d09724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.336486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-de88a2d5-8acb-4a24-bbdb-d7bf0f78a815 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:56.338083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-de88a2d5-8acb-4a24-bbdb-d7bf0f78a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.341775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 920/1836] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:56.346894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 917/1837] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:56.347682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eece166-4e29-42d7-8f18-2269c7d09724 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.349921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e094f-8f69-4406-8412-8b5efee8f9d4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.350523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e094f-8f69-4406-8412-8b5efee8f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.351122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e094f-8f69-4406-8412-8b5efee8f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.366241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eece166-4e29-42d7-8f18-2269c7d09724 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.377976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.378833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.379246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-601e094f-8f69-4406-8412-8b5efee8f9d4 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:56.379510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.379930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.380664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.381353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-601e094f-8f69-4406-8412-8b5efee8f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.382629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.391808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 918/1838] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:56.392995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e094f-8f69-4406-8412-8b5efee8f9d4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.399060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 921/1839] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:56.403749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.405586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e094f-8f69-4406-8412-8b5efee8f9d4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.406298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.411223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.412056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.412548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.413010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.414120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:56.414628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.416443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.423757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331d0f-c430-4cb8-8974-81a18f71c596 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.430115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.430886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.431257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.431811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] PATH_INFO: `/v3/projects/ba437bc9851b4d67a4cf21b0e27e0291` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.433663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba437bc9851b4d67a4cf21b0e27e0291)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.435850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.450888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 919/1840] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:56.452055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.487468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f660c-5ebc-423f-aed9-6ec5c477d6c8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.499473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.500113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.500448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.500714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.501395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:56.501985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.503306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.523473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 920/1841] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:56.524803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.539144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba437bc9851b4d67a4cf21b0e27e0291', 'request_id': 'req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.553226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba437bc9851b4d67a4cf21b0e27e0291', 'request_id': 'req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.575656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431804d9-52d7-48d4-bc65-55a6ced70aa4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.594007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba437bc9851b4d67a4cf21b0e27e0291', 'request_id': 'req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.612828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:56.636262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] The token cache is being invalidate because project ba437bc9851b4d67a4cf21b0e27e0291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:56.636913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.639770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:56.641636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 922/1842] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:56 2022] DELETE /identity/v3/projects/ba437bc9851b4d67a4cf21b0e27e0291 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:56.643891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.670029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.683051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.683866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.684213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.684560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] PATH_INFO: `/v3/projects/1d7f367e4bc848d1b4f433bbf12de6f0/users/273296c6f55f49f0ac7db3b74121bd84/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.703414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7f367e4bc848d1b4f433bbf12de6f0, user_id=273296c6f55f49f0ac7db3b74121bd84, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.707516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.733569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 921/1843] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:56 2022] PUT /identity/v3/projects/1d7f367e4bc848d1b4f433bbf12de6f0/users/273296c6f55f49f0ac7db3b74121bd84/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:56.735162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.737314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.761722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9f89d-ddb4-4c76-9d9c-053113d20ed1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.774530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:56.825094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2b042-b06c-44d2-9949-6958c96c9791 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.834096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc75bd9-5579-43ae-8502-4baebe807989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.834735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc75bd9-5579-43ae-8502-4baebe807989 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.835013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc75bd9-5579-43ae-8502-4baebe807989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.835501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc75bd9-5579-43ae-8502-4baebe807989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.836927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc75bd9-5579-43ae-8502-4baebe807989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.837514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f579b2-e790-4627-90bf-ee6c49f024e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.838050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f579b2-e790-4627-90bf-ee6c49f024e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.838348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f579b2-e790-4627-90bf-ee6c49f024e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.838626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f579b2-e790-4627-90bf-ee6c49f024e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.839128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc75bd9-5579-43ae-8502-4baebe807989 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.839239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f579b2-e790-4627-90bf-ee6c49f024e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.841137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f579b2-e790-4627-90bf-ee6c49f024e9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:56.874657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 922/1845] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:56.874657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dec027-30e7-4505-8996-a9d4b5524d83 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.874979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 923/1845] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:56.875078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dec027-30e7-4505-8996-a9d4b5524d83 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.875078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dec027-30e7-4505-8996-a9d4b5524d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.875721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53180-fd93-4bd0-bdf6-a4751508a938 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.876062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53180-fd93-4bd0-bdf6-a4751508a938 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.876300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53180-fd93-4bd0-bdf6-a4751508a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.897061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-72dec027-30e7-4505-8996-a9d4b5524d83 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:56.898419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-72dec027-30e7-4505-8996-a9d4b5524d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.912527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-52a53180-fd93-4bd0-bdf6-a4751508a938 None None] MFA Rules not processed for user `273296c6f55f49f0ac7db3b74121bd84`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:56.914494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-52a53180-fd93-4bd0-bdf6-a4751508a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:56.970267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 923/1846] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:56.970267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dec027-30e7-4505-8996-a9d4b5524d83 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:56.974657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dec027-30e7-4505-8996-a9d4b5524d83 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:56.981232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a523-5018-4342-b8d1-7338a21f0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:56.982006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a523-5018-4342-b8d1-7338a21f0e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:56.982301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a523-5018-4342-b8d1-7338a21f0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:56.982545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a523-5018-4342-b8d1-7338a21f0e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:56.983313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a523-5018-4342-b8d1-7338a21f0e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:56.985121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a523-5018-4342-b8d1-7338a21f0e73 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.003944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 924/1847] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:57.005069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a53180-fd93-4bd0-bdf6-a4751508a938 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.009980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 924/1848] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:56 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.011419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e909410-2c75-4029-a280-413441390fef None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.011922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e909410-2c75-4029-a280-413441390fef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.012194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e909410-2c75-4029-a280-413441390fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.019965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:57.026533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a53180-fd93-4bd0-bdf6-a4751508a938 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.032776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.033456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.033744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.034015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.034648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.035521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0e909410-2c75-4029-a280-413441390fef None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:57.036578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.036744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0e909410-2c75-4029-a280-413441390fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:57.044632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 925/1849] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:57.047981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e909410-2c75-4029-a280-413441390fef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.047981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0e909410-2c75-4029-a280-413441390fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:57.058485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e909410-2c75-4029-a280-413441390fef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.060486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 925/1850] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.061311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.063367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.063805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.064093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.064367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.064984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.066941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.071986 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bf595-dc00-4b69-8fba-a6d14425270b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.076627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.077225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.077540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.077814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.078451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.080037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.094416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 926/1851] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.094416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.098087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 926/1852] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.102647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.105282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a061-9d95-4022-89de-9d1437b9c50f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.161145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:57.170322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.170985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.171269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.171805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.172489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14148ccc-5752-4af5-a87f-3eac50590834 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.172993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:57.173938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.176175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.177336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.177983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.178262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.178535 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.179254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.181644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.192203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 927/1853] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:57.192203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.192794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 927/1854] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.193282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.200490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d7162-34ea-449b-a23c-ae452b2b4d07 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.204759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fe5d2-e200-4887-96f8-143972082573 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.205185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.205902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.206335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.206754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.207490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.209140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.209293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.209914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.210192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.210718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.211714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.213645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.220835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 928/1855] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.221860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.234455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5a0e-ff0d-4973-a5c1-6bc4c2554c46 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.236600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 928/1856] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/users => generated 300 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.237270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.242133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.242876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.243160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.243436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.244083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.245866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.249312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7bab-f44a-4b16-853b-15236d5687de admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.253887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.254482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.254759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.255028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.255644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.259280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 929/1857] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.259280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.259533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.268537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a4f0-9fdb-413f-9f8b-623a1c7a7ef5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.273198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.273888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.274170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.274444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] PATH_INFO: `/v3/projects/f5ac8da8288d4f5ba47806d4f1b673e6/users/5bf1b67af1324556afc52ff3eac83829/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.288134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 929/1858] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.290087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.290431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ac8da8288d4f5ba47806d4f1b673e6, user_id=5bf1b67af1324556afc52ff3eac83829, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.293127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.314344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 930/1859] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:57 2022] PUT /identity/v3/projects/f5ac8da8288d4f5ba47806d4f1b673e6/users/5bf1b67af1324556afc52ff3eac83829/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:57.319058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.358005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8aac9-2e0d-48f4-acf8-a2664d4bf770 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.382892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348005f-976c-411b-b48a-4f40cb207539 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.387843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.388509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.388784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.389056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] PATH_INFO: `/v3/projects/58c33a71055c452fa000c416662d5605/users/1065a63effab45f48d6ffb7d52db4f8b/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.390709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:57.403790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c33a71055c452fa000c416662d5605, user_id=1065a63effab45f48d6ffb7d52db4f8b, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.406486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.414864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ec11-a5d6-4298-b38c-034a06e79850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.415487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ec11-a5d6-4298-b38c-034a06e79850 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.415785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ec11-a5d6-4298-b38c-034a06e79850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.416078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ec11-a5d6-4298-b38c-034a06e79850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.416739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5ec11-a5d6-4298-b38c-034a06e79850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.418377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5ec11-a5d6-4298-b38c-034a06e79850 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.421078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 931/1860] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:57 2022] PUT /identity/v3/projects/58c33a71055c452fa000c416662d5605/users/1065a63effab45f48d6ffb7d52db4f8b/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:57.421993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.428350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 930/1861] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.429654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674947-15ea-4a6e-ba79-91af8eda9af6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.429945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674947-15ea-4a6e-ba79-91af8eda9af6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.430222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674947-15ea-4a6e-ba79-91af8eda9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.458275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d9674947-15ea-4a6e-ba79-91af8eda9af6 None None] MFA Rules not processed for user `5bf1b67af1324556afc52ff3eac83829`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:57.459497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d9674947-15ea-4a6e-ba79-91af8eda9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:57.493037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2e39-665f-4c75-9a91-215de784d961 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.497661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.498313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.498592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.498861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.499487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.501421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.523835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 931/1862] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:57.525105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.525412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.525690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.527539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 932/1863] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.528416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.539625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452daf5-3f51-47da-abce-6bcd864a76aa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.544657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.545339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.545654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.545932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] PATH_INFO: `/v3/projects/238f29be7d7b410790d443044545c850/users/e3c4d99e26df4af8be67f972bb1802ad/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.559699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] MFA Rules not processed for user `1065a63effab45f48d6ffb7d52db4f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:57.560922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:57.562029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238f29be7d7b410790d443044545c850, user_id=e3c4d99e26df4af8be67f972bb1802ad, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.564957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.568945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:57.587606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 933/1864] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:57 2022] PUT /identity/v3/projects/238f29be7d7b410790d443044545c850/users/e3c4d99e26df4af8be67f972bb1802ad/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:57.588621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.661522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 932/1865] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:57.662783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90be47-573a-4d37-a192-22ad6b5ae618 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.663938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.667273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:57.668153 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.668868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.669222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.669610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.670766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.672569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.702776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 934/1866] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.703579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.719604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c904-a1fe-4aa3-9899-6d5c5f71bed3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.730053 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.730705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.730984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.731322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.731872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.733559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.754421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 935/1867] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.755353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.759439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d35c-7636-441a-9147-ee3502e9172c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.765757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:57.766146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abcc5a-59c4-4894-8b5d-2e09c975e10a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.771055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.771675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.771953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.772215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.773075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.775064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.812538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 936/1868] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.813595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.827126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.827754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.828075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.828327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.910542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdc92-71d7-446a-8135-3ab89c07d742 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.910840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.912360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.915527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.916227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.916513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.916792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.917472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.919140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.923315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 933/1869] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:57.924129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.934755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 937/1870] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:57.935657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.939274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7cd3-ef4d-44eb-8df6-fa2b681bef32 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.945902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.946540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95dee-b39b-45ef-8ad9-bb8c1be821ea admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:57.946754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.947039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.947313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] PATH_INFO: `/v3/projects/238f29be7d7b410790d443044545c850/users/e3c4d99e26df4af8be67f972bb1802ad/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.949801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238f29be7d7b410790d443044545c850, user_id=e3c4d99e26df4af8be67f972bb1802ad, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.951695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d702e0-e6f0-4e23-83ea-635dfae34025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:57.952523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d702e0-e6f0-4e23-83ea-635dfae34025 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.952836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.952952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d702e0-e6f0-4e23-83ea-635dfae34025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.953309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d702e0-e6f0-4e23-83ea-635dfae34025 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:57.954134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d702e0-e6f0-4e23-83ea-635dfae34025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:57.956119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d702e0-e6f0-4e23-83ea-635dfae34025 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:57.971784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 934/1871] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:57 2022] PUT /identity/v3/projects/238f29be7d7b410790d443044545c850/users/e3c4d99e26df4af8be67f972bb1802ad/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:57.981258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:57.988842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 938/1872] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:57.988842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dd257-9563-45c1-8fd9-187fbf80e9f6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:57.988842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dd257-9563-45c1-8fd9-187fbf80e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:57.988842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dd257-9563-45c1-8fd9-187fbf80e9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.028908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-201dd257-9563-45c1-8fd9-187fbf80e9f6 None None] MFA Rules not processed for user `e3c4d99e26df4af8be67f972bb1802ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:58.030122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-201dd257-9563-45c1-8fd9-187fbf80e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:58.059521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:58.097158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f125a-b77f-40e6-956a-9d6993fc8139 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.113957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af5523-5ea7-4e2d-905c-8f1086732925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.114941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af5523-5ea7-4e2d-905c-8f1086732925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.115222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af5523-5ea7-4e2d-905c-8f1086732925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.115500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af5523-5ea7-4e2d-905c-8f1086732925 admin admin] PATH_INFO: `/v3/projects/ed68a6445c6f4f22833c0903714fadc4/users/c841bcfe417a4ff79f0ad10333911405/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.140338 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af5523-5ea7-4e2d-905c-8f1086732925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed68a6445c6f4f22833c0903714fadc4, user_id=c841bcfe417a4ff79f0ad10333911405, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.144163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af5523-5ea7-4e2d-905c-8f1086732925 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.149645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 939/1873] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:58.152144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dd257-9563-45c1-8fd9-187fbf80e9f6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.172513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dd257-9563-45c1-8fd9-187fbf80e9f6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.192059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 935/1874] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:57 2022] PUT /identity/v3/projects/ed68a6445c6f4f22833c0903714fadc4/users/c841bcfe417a4ff79f0ad10333911405/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:58.196162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa08f4-e306-4389-9a0e-8c358c9d1007 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.196580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa08f4-e306-4389-9a0e-8c358c9d1007 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.197299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa08f4-e306-4389-9a0e-8c358c9d1007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.236516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-87fa08f4-e306-4389-9a0e-8c358c9d1007 None None] MFA Rules not processed for user `c841bcfe417a4ff79f0ad10333911405`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:58.238235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-87fa08f4-e306-4389-9a0e-8c358c9d1007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:58.277359 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:58.282320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.282947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.283231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.283505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.284161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.285845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.297635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 940/1875] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:58.298720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.302510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:58.345095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 936/1876] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:58.350551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa08f4-e306-4389-9a0e-8c358c9d1007 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.364747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa08f4-e306-4389-9a0e-8c358c9d1007 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.370865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.371565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.372059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.372227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] PATH_INFO: `/v3/projects/453808f8c63b45c2b93582f9e4944676/users/767047bbf2694bbf958381e61f227872/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.375793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558dff2-2d6d-417c-9fd0-79e1641266a0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.381127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.382430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.382709 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.382983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.390112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453808f8c63b45c2b93582f9e4944676, user_id=767047bbf2694bbf958381e61f227872, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.393078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.431125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 937/1877] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:58 2022] PUT /identity/v3/projects/453808f8c63b45c2b93582f9e4944676/users/767047bbf2694bbf958381e61f227872/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:58.431125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.519581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7ba29-b00c-42d5-8d14-99d2698fbbe0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.523809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.524972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.525261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.525757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.526129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.526469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.527163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.529139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.536114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 941/1878] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:58.536968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.548315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fa8ec-d956-40e1-a6da-50dfdb3c7ff2 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.553613 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.554378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.554643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.554878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.555546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.557231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.558772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:58.571079 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 938/1879] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:58 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:58.576631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 942/1880] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:58.577081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.578461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.595715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8f71c-9d32-4edb-a931-1b21b5baaa27 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.664499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c640df-fb90-47e1-a693-1360fa19018b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.671281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.671955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.672226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.672538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.673254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.675247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.689258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4032080-0517-4511-86f9-4fe39f4e2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.689904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4032080-0517-4511-86f9-4fe39f4e2cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.690212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4032080-0517-4511-86f9-4fe39f4e2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.690477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4032080-0517-4511-86f9-4fe39f4e2cda admin admin] PATH_INFO: `/v3/projects/453808f8c63b45c2b93582f9e4944676/users/767047bbf2694bbf958381e61f227872/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.692955 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4032080-0517-4511-86f9-4fe39f4e2cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=453808f8c63b45c2b93582f9e4944676, user_id=767047bbf2694bbf958381e61f227872, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.696043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4032080-0517-4511-86f9-4fe39f4e2cda admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.705405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 939/1881] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:58 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:33:58.707009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.709229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 943/1882] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:58 2022] PUT /identity/v3/projects/453808f8c63b45c2b93582f9e4944676/users/767047bbf2694bbf958381e61f227872/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:58.721429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d871db-4736-44e3-b4ef-5f05bda009c9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.721715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d871db-4736-44e3-b4ef-5f05bda009c9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.721994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d871db-4736-44e3-b4ef-5f05bda009c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.726242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0f2a-8169-4e5c-a716-3d394f567209 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.738156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:58.756523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-72d871db-4736-44e3-b4ef-5f05bda009c9 None None] MFA Rules not processed for user `767047bbf2694bbf958381e61f227872`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:58.758657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-72d871db-4736-44e3-b4ef-5f05bda009c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:58.831070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.831791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.832141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.832504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.833223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.834981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.846035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 940/1883] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:33:58.849798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.856517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 944/1884] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:58.866915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3478f-b2d7-4327-a8a2-3d02b2088f0e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:58.872530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:58.873209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:58.873532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:58.873852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] PATH_INFO: `/v3/projects/e8444892246046c48f2469be5a0bb5c1/users/2c1287727b584c29bcb3b97f28b324cc/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:58.874948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d871db-4736-44e3-b4ef-5f05bda009c9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.898043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8444892246046c48f2469be5a0bb5c1, user_id=2c1287727b584c29bcb3b97f28b324cc, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:58.901896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:58.928712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 941/1885] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:58 2022] PUT /identity/v3/projects/e8444892246046c48f2469be5a0bb5c1/users/2c1287727b584c29bcb3b97f28b324cc/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:33:58.933311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:58.966390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d871db-4736-44e3-b4ef-5f05bda009c9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:59.006737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:59.036782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:59.037534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:59.037896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:59.038138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:59.039374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb359803-e931-4709-ab5a-50f95863ee7d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:59.044995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:59.045806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:59.046085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:59.046576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:59.047504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:59.049347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:59.072161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 942/1886] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:59.073440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:59.084257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2363-4b79-418e-971a-bec3258179b8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:59.103596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dba119-6f27-4e83-942d-c0c9be7ea9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:59.104322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba119-6f27-4e83-942d-c0c9be7ea9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:59.104565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba119-6f27-4e83-942d-c0c9be7ea9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:59.104842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba119-6f27-4e83-942d-c0c9be7ea9e6 admin admin] PATH_INFO: `/v3/projects/e8444892246046c48f2469be5a0bb5c1/users/2c1287727b584c29bcb3b97f28b324cc/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:59.106932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dba119-6f27-4e83-942d-c0c9be7ea9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8444892246046c48f2469be5a0bb5c1, user_id=2c1287727b584c29bcb3b97f28b324cc, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:59.109729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dba119-6f27-4e83-942d-c0c9be7ea9e6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:59.134514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 943/1887] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:59 2022] PUT /identity/v3/projects/e8444892246046c48f2469be5a0bb5c1/users/2c1287727b584c29bcb3b97f28b324cc/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:59.135997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:59.137500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:59.156308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08c96d-5dcf-4bab-b466-4a5fae669477 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:59.157227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08c96d-5dcf-4bab-b466-4a5fae669477 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:59.157335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08c96d-5dcf-4bab-b466-4a5fae669477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:59.157757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 945/1888] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:33:59.216117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6b08c96d-5dcf-4bab-b466-4a5fae669477 None None] MFA Rules not processed for user `2c1287727b584c29bcb3b97f28b324cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:59.218644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b08c96d-5dcf-4bab-b466-4a5fae669477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:59.276167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:59.287108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7e3b8-1c07-469c-95aa-42807ee7823a service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:59.319103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:59.340200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 944/1889] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:59.356549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:59.357642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:59.358021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:59.358269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:59.360077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:59.437698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:59.437698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:59.441093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 946/1890] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:59.460180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08c96d-5dcf-4bab-b466-4a5fae669477 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:59.471588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08c96d-5dcf-4bab-b466-4a5fae669477 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:59.475555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:59.476388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:59.476666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:59.477061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:59.487868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:59.489306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:59.504799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 945/1891] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:59.651200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:59.666743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fc865-4033-461b-ae73-4d5351fc934a service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:59.670344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362ba44-fc38-4492-bf86-304cc51180ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:59.670953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ba44-fc38-4492-bf86-304cc51180ab service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:59.671231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ba44-fc38-4492-bf86-304cc51180ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:59.671495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ba44-fc38-4492-bf86-304cc51180ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:59.719094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:59.754294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362ba44-fc38-4492-bf86-304cc51180ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:59.755786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362ba44-fc38-4492-bf86-304cc51180ab service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:59.766823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 947/1892] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:02.061001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:02.072091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39582a12-b149-49f9-a410-1720b7351d63 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:02.076467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e53b5-a60e-4eb5-8300-0beebe292e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:02.077138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e53b5-a60e-4eb5-8300-0beebe292e93 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:02.077465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e53b5-a60e-4eb5-8300-0beebe292e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:02.077737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e53b5-a60e-4eb5-8300-0beebe292e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:02.148910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e53b5-a60e-4eb5-8300-0beebe292e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:02.150500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e53b5-a60e-4eb5-8300-0beebe292e93 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:02.162131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 946/1893] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:02.860752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f31ea-9c0a-4e99-8445-c71be125dc14 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:02.861398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f31ea-9c0a-4e99-8445-c71be125dc14 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:02.861398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f31ea-9c0a-4e99-8445-c71be125dc14 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:02.862759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 948/1894] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:34:02.879206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09c46-9bd6-4a63-b74f-719afbdb8d1c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:02.879690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09c46-9bd6-4a63-b74f-719afbdb8d1c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:02.879983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09c46-9bd6-4a63-b74f-719afbdb8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:02.901890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6be09c46-9bd6-4a63-b74f-719afbdb8d1c None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:02.903420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6be09c46-9bd6-4a63-b74f-719afbdb8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:02.973769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 947/1895] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:34:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:03.002680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f31ea-9c0a-4e99-8445-c71be125dc14 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:03.004442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-660f31ea-9c0a-4e99-8445-c71be125dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:03.054950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f31ea-9c0a-4e99-8445-c71be125dc14 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:03.070250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:03.070892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:03.071399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:03.075037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:03.090841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:03.093289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:03.120519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 949/1896] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:03.811990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09c46-9bd6-4a63-b74f-719afbdb8d1c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:03.961835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09c46-9bd6-4a63-b74f-719afbdb8d1c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:03.966531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:03.967483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:03.967952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:03.968109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:03.968965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] PATH_INFO: `/v3/users/c841bcfe417a4ff79f0ad10333911405` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:03.970356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c841bcfe417a4ff79f0ad10333911405)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:03.973010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:03.979087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c40ed-ff6b-405f-9c3e-0674bb20d785 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:03.982117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:03.985739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f474-7219-4d7a-9aec-89847856b02f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:03.986845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f474-7219-4d7a-9aec-89847856b02f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:03.987120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f474-7219-4d7a-9aec-89847856b02f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:03.987389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f474-7219-4d7a-9aec-89847856b02f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:04.062520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c841bcfe417a4ff79f0ad10333911405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.069802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f474-7219-4d7a-9aec-89847856b02f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:04.071434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f474-7219-4d7a-9aec-89847856b02f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:04.079002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c841bcfe417a4ff79f0ad10333911405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.079920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c841bcfe417a4ff79f0ad10333911405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.085602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 950/1897] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:04.096760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c841bcfe417a4ff79f0ad10333911405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.097611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c841bcfe417a4ff79f0ad10333911405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.113405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 948/1898] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:03 2022] DELETE /identity/v3/users/c841bcfe417a4ff79f0ad10333911405 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:04.117929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:04.118283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:04.118776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:04.140222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:04.141954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:04.219578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 951/1899] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:04.230147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:04.231777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:04.308248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79a79c-d338-4345-8a86-74369e9f2968 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:04.313006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:04.313807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:04.314254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:04.314585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:04.324939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:04.326432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:04.336852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 949/1900] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:04.579657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:04.581274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:04.594952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc086a-5465-465b-98f4-2a6664019fde None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:04.600204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:04.600927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:04.601211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:04.601525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] PATH_INFO: `/v3/users/5bf1b67af1324556afc52ff3eac83829` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:04.602746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf1b67af1324556afc52ff3eac83829)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:04.607162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:04.675751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf1b67af1324556afc52ff3eac83829'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.679524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:04.684740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:04.695752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf1b67af1324556afc52ff3eac83829'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.709817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:04.732403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf1b67af1324556afc52ff3eac83829'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.733180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf1b67af1324556afc52ff3eac83829'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.733988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-303d7c12-a890-4c76-b377-8185422f568a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf1b67af1324556afc52ff3eac83829'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.738061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf666a46-3f3a-4a0b-b53c-c97dae930815 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:04.750589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 952/1901] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:04 2022] DELETE /identity/v3/users/5bf1b67af1324556afc52ff3eac83829 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:04.751142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:04.752572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:04.753425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:04.753425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] PATH_INFO: `/v3/projects/ed68a6445c6f4f22833c0903714fadc4` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:04.755780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd77ec-c004-464a-905b-41cf16b617af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:04.756088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd77ec-c004-464a-905b-41cf16b617af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:04.756365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd77ec-c004-464a-905b-41cf16b617af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:04.757656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed68a6445c6f4f22833c0903714fadc4)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:04.760202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:04.781729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-debd77ec-c004-464a-905b-41cf16b617af None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:04.783536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-debd77ec-c004-464a-905b-41cf16b617af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:04.872967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed68a6445c6f4f22833c0903714fadc4', 'request_id': 'req-d165be8e-a0c6-4b78-b431-b278b456ca00'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.893031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed68a6445c6f4f22833c0903714fadc4', 'request_id': 'req-d165be8e-a0c6-4b78-b431-b278b456ca00'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.900573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed68a6445c6f4f22833c0903714fadc4', 'request_id': 'req-d165be8e-a0c6-4b78-b431-b278b456ca00'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.904056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 953/1902] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:04.912531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd77ec-c004-464a-905b-41cf16b617af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:04.915618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-debd77ec-c004-464a-905b-41cf16b617af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:04.929273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] The token cache is being invalidate because project ed68a6445c6f4f22833c0903714fadc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:04.929580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.930209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:04.933412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 950/1903] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:04 2022] DELETE /identity/v3/projects/ed68a6445c6f4f22833c0903714fadc4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:04.936316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:04.938434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:04.961619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:05.008661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd77ec-c004-464a-905b-41cf16b617af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:05.056592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165be8e-a0c6-4b78-b431-b278b456ca00 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:05.063506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:05.064085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:05.064363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:05.064636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] PATH_INFO: `/v3/users/2c1287727b584c29bcb3b97f28b324cc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:05.065973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1287727b584c29bcb3b97f28b324cc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:05.068230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:05.083759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:05.084927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:05.085476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:05.085891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:05.091765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:05.139217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:05.141267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:05.185240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 954/1904] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:05.211123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1287727b584c29bcb3b97f28b324cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:05.242201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1287727b584c29bcb3b97f28b324cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:05.243059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1287727b584c29bcb3b97f28b324cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:05.270545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1287727b584c29bcb3b97f28b324cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:05.273628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1287727b584c29bcb3b97f28b324cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:05.304442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 951/1905] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:04 2022] DELETE /identity/v3/users/2c1287727b584c29bcb3b97f28b324cc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:05.921690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:05.923128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:05.934967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:05.937153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:05.938590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080e63-ed07-4377-b172-c77c4f9238c3 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:05.992026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:06.022270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.023253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.023540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.023819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] PATH_INFO: `/v3/projects/f5ac8da8288d4f5ba47806d4f1b673e6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.025039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ac8da8288d4f5ba47806d4f1b673e6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.027067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.044294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f692ed-f74e-46e9-bff1-04cf3fb55bb3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.048894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.049568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.049846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.050113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] PATH_INFO: `/v3/projects/e8444892246046c48f2469be5a0bb5c1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.051223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8444892246046c48f2469be5a0bb5c1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.053253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.078203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ac8da8288d4f5ba47806d4f1b673e6', 'request_id': 'req-409b395d-609a-4add-a1ce-3703a0185cdb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.085353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ac8da8288d4f5ba47806d4f1b673e6', 'request_id': 'req-409b395d-609a-4add-a1ce-3703a0185cdb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.095012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:06.095355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ac8da8288d4f5ba47806d4f1b673e6', 'request_id': 'req-409b395d-609a-4add-a1ce-3703a0185cdb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.110329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] The token cache is being invalidate because project f5ac8da8288d4f5ba47806d4f1b673e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:06.111216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.112487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8444892246046c48f2469be5a0bb5c1', 'request_id': 'req-9f58f442-9ec4-4715-87d0-80c8e1090e1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.114081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-409b395d-609a-4add-a1ce-3703a0185cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.121738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 955/1906] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:05 2022] DELETE /identity/v3/projects/f5ac8da8288d4f5ba47806d4f1b673e6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:06.123073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8444892246046c48f2469be5a0bb5c1', 'request_id': 'req-9f58f442-9ec4-4715-87d0-80c8e1090e1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.123926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61751c-8b6c-4a4f-80a0-fb309bfe516d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.124312 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61751c-8b6c-4a4f-80a0-fb309bfe516d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.124756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61751c-8b6c-4a4f-80a0-fb309bfe516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.133728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8444892246046c48f2469be5a0bb5c1', 'request_id': 'req-9f58f442-9ec4-4715-87d0-80c8e1090e1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.149114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] The token cache is being invalidate because project e8444892246046c48f2469be5a0bb5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:06.149518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.150357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f58f442-9ec4-4715-87d0-80c8e1090e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:06.152305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 952/1907] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:05 2022] DELETE /identity/v3/projects/e8444892246046c48f2469be5a0bb5c1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:06.155963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9f61751c-8b6c-4a4f-80a0-fb309bfe516d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:06.157421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9f61751c-8b6c-4a4f-80a0-fb309bfe516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:06.157676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60943f2f-c30d-4980-8bba-f32bd141d78e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.158023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60943f2f-c30d-4980-8bba-f32bd141d78e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.158386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60943f2f-c30d-4980-8bba-f32bd141d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.196264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-60943f2f-c30d-4980-8bba-f32bd141d78e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:06.197513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60943f2f-c30d-4980-8bba-f32bd141d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:06.245787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 956/1908] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:06.247276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b06c18-c85d-4929-9584-8b978039ba17 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.253606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b06c18-c85d-4929-9584-8b978039ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.253993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b06c18-c85d-4929-9584-8b978039ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.271519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 953/1909] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:06.279280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb327210-2514-4af6-af54-a3e2336dbd44 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.279716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb327210-2514-4af6-af54-a3e2336dbd44 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.280128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb327210-2514-4af6-af54-a3e2336dbd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.281586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-64b06c18-c85d-4929-9584-8b978039ba17 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:06.283240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-64b06c18-c85d-4929-9584-8b978039ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:06.293879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 957/1910] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:06.298685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b06c18-c85d-4929-9584-8b978039ba17 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.307174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bb327210-2514-4af6-af54-a3e2336dbd44 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:06.308146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b06c18-c85d-4929-9584-8b978039ba17 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.309173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bb327210-2514-4af6-af54-a3e2336dbd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:06.314198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.315062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.316382 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.316817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.318478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:06.318928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.322117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.325635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 954/1911] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:06.327200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb327210-2514-4af6-af54-a3e2336dbd44 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.341253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb327210-2514-4af6-af54-a3e2336dbd44 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.343237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 958/1912] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:34:06.347889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.354633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.355377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.355949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.356312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.359905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:06.360292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.362367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.364884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341088b-0361-4e62-819c-255b97442b08 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.386140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.386811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.387094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.401393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.401393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.401393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.401740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 955/1913] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:06.401740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.407395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15241e6e-f0a0-431b-8991-f20e026c8452 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.415015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.416227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.416490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.416768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.417571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.419708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.424931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 959/1914] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:06.431009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.456776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 956/1915] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:06.461179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.462626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:06.512627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aefc7b-c7d5-4942-bd80-ad39fe3cba73 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.534430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc7b4-a2b4-4639-9b2c-d0514f0e05a5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.540643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.541349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.541663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.541935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.542573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.544676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.569707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 957/1916] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:06.574402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.577804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.578439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.578724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.579008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.579728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.581841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.586702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b450677-b1a0-41ca-90db-e7cd96766694 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.593912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.594987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.595969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.596354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.597037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.599087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.602540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:06.613195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 960/1917] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:06.617965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.633965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 958/1918] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:06.635980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465532eb-480a-4089-8627-712845cd6ed6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.637703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.645754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.647063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.647565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.647842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.648502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.650238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.668875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8bc9-ba04-4b11-81fa-96d5340da957 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.676413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 961/1919] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:06.681288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.682093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.682363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.682646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.682921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.683695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.685303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.693710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48354686-3596-4633-b6bb-63bff016c5b2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.698717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.699551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.699658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 959/1920] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:06.703206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.703463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.704169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.705816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.708936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.720782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560090-ffc0-4b6c-ab44-5bbb2cc46b9f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.725032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 962/1921] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:06.725818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad9e2-b95c-453a-a9a5-0fc06d2fee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.726231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.726760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad9e2-b95c-453a-a9a5-0fc06d2fee2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.727133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad9e2-b95c-453a-a9a5-0fc06d2fee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.727582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad9e2-b95c-453a-a9a5-0fc06d2fee2f admin admin] PATH_INFO: `/v3/projects/f612fe0021914a85af2cfb5a18de048d/users/f7326dbe6fb74e1a8c8908b9a8e829a3/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.743050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026defe-8122-4156-b57c-227e1061e04b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.745101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad9e2-b95c-453a-a9a5-0fc06d2fee2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f612fe0021914a85af2cfb5a18de048d, user_id=f7326dbe6fb74e1a8c8908b9a8e829a3, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.747933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad9e2-b95c-453a-a9a5-0fc06d2fee2f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.748096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.748780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.749064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.749342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] PATH_INFO: `/v3/projects/cb757e381c864198b465706584ff0978/users/581bbbcd858d42f89a901b49aa90438d/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.768064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 960/1922] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:06 2022] PUT /identity/v3/projects/f612fe0021914a85af2cfb5a18de048d/users/f7326dbe6fb74e1a8c8908b9a8e829a3/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:06.771553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb757e381c864198b465706584ff0978, user_id=581bbbcd858d42f89a901b49aa90438d, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.780371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5638-b8b9-404c-8495-d0586d109618 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.780659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5638-b8b9-404c-8495-d0586d109618 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.780920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5638-b8b9-404c-8495-d0586d109618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.782004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.805688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 963/1923] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:06 2022] PUT /identity/v3/projects/cb757e381c864198b465706584ff0978/users/581bbbcd858d42f89a901b49aa90438d/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:06.806457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:06.808095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:06.844148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ea2a5638-b8b9-404c-8495-d0586d109618 None None] MFA Rules not processed for user `f7326dbe6fb74e1a8c8908b9a8e829a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:06.844148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ea2a5638-b8b9-404c-8495-d0586d109618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:06.916903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eefca-8777-4e91-be60-de727d52fc9b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:06.927505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:06.927505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.927505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.927505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] PATH_INFO: `/v3/users/0b8802d2e5ae4757a1de4c8370c0bab1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.928941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8802d2e5ae4757a1de4c8370c0bab1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:06.931467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:06.948552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 961/1924] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:06.949832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e3044-3e93-4c38-b8b4-89466e26c873 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:06.950210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e3044-3e93-4c38-b8b4-89466e26c873 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:06.950740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e3044-3e93-4c38-b8b4-89466e26c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:06.960315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:06.981677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-556e3044-3e93-4c38-b8b4-89466e26c873 None None] MFA Rules not processed for user `581bbbcd858d42f89a901b49aa90438d`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:06.983106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-556e3044-3e93-4c38-b8b4-89466e26c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.007086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8802d2e5ae4757a1de4c8370c0bab1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:07.017441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8802d2e5ae4757a1de4c8370c0bab1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:07.035801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8802d2e5ae4757a1de4c8370c0bab1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:07.036530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8802d2e5ae4757a1de4c8370c0bab1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:07.037188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8802d2e5ae4757a1de4c8370c0bab1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:07.050349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 964/1925] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:06 2022] DELETE /identity/v3/users/0b8802d2e5ae4757a1de4c8370c0bab1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:07.051317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.054591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.059946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 962/1926] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:07.061392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.061706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.061987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.083145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:07.084372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.125731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:07.126257 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f77e-ca3d-4808-ad94-2dd8be559832 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.132247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.132900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.133184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.133489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.134131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.136092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.147146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 963/1927] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:07.149898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.149898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.161817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bc94c-da02-42f6-9f79-1ed416f62106 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.166640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.167075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 965/1928] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:07 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:07.167252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.167533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.167808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.168033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.168563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.169645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.170545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.199857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 964/1929] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:07 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:07.200673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.233342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168795-7dee-450f-a16c-107f76b63dcf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.260667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13409b-7765-4ecb-9f81-7976ec89e561 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.264837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:07.265692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.266209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.266520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.267048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.267714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.269824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.283142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.283835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.284142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.284478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.296026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 965/1930] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:07 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:07.296026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.297263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.298855 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.303361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b935c6-ac83-4a0f-83de-12727477909c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.308048 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.308646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.308932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.309149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 966/1931] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:07.309249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.309849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.310081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.311971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.319841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673deaec-902d-4da4-8203-c42968c1c8ef service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.324791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.325408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.325715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.326033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.326585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.328223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.340043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 966/1932] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:07 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:07.341165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.352691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d693b-ab85-4b99-baba-51664ea5308a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.356013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 967/1933] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:07.358749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.359583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.359833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.360241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.360918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.361079 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.362794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.385060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba447-da4d-4abc-84a2-ef6f3f834d81 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.393070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.393900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.394264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.394440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] PATH_INFO: `/v3/projects/49f9a886e292486692aaccd6824ae703/users/4d793b51fde441afac318ec839730bff/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.401927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 967/1934] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:07.404018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.429432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f9a886e292486692aaccd6824ae703, user_id=4d793b51fde441afac318ec839730bff, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.429709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed115f-4cc3-4908-bc9c-8705857377b5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.432359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.440705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.441436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.441772 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.442050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] PATH_INFO: `/v3/projects/bc7fa387e7784304ae53ace0317c2c6d/users/930bcb81b8444e28a060acccd5289dc8/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.461349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7fa387e7784304ae53ace0317c2c6d, user_id=930bcb81b8444e28a060acccd5289dc8, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.465155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.469150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 968/1935] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:07 2022] PUT /identity/v3/projects/49f9a886e292486692aaccd6824ae703/users/4d793b51fde441afac318ec839730bff/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:07.475308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.509431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 968/1936] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:07 2022] PUT /identity/v3/projects/bc7fa387e7784304ae53ace0317c2c6d/users/930bcb81b8444e28a060acccd5289dc8/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:07.510433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.589104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895143-4133-490e-b6a7-f45619485514 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.616703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:07.621178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ec15-3cc7-4736-80b8-344771fe742d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.628838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.629893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.630322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.630801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.631870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.634141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.650236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 969/1937] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:07.651168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.662620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831ae0-5cd2-49c1-a266-bc223593fb6b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.671262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.672381 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.672663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.672936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] PATH_INFO: `/v3/projects/bc7fa387e7784304ae53ace0317c2c6d/users/930bcb81b8444e28a060acccd5289dc8/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.679125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82885bc-3a0f-42c6-83be-19f09da50019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.680146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82885bc-3a0f-42c6-83be-19f09da50019 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.680942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82885bc-3a0f-42c6-83be-19f09da50019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.681633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82885bc-3a0f-42c6-83be-19f09da50019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.682186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82885bc-3a0f-42c6-83be-19f09da50019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.684086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82885bc-3a0f-42c6-83be-19f09da50019 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.687940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7fa387e7784304ae53ace0317c2c6d, user_id=930bcb81b8444e28a060acccd5289dc8, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.693274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.708822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 970/1938] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:07 2022] PUT /identity/v3/projects/bc7fa387e7784304ae53ace0317c2c6d/users/930bcb81b8444e28a060acccd5289dc8/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:07.719760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 969/1939] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:07.720867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.726290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd187-e597-4743-ae04-8cacaea38854 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.726583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd187-e597-4743-ae04-8cacaea38854 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.726861 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd187-e597-4743-ae04-8cacaea38854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.784460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5d0fd187-e597-4743-ae04-8cacaea38854 None None] MFA Rules not processed for user `930bcb81b8444e28a060acccd5289dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:07.785527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5d0fd187-e597-4743-ae04-8cacaea38854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.818839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed294-3674-4b14-97a6-c1007627e1f5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.824227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.825142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.825458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.825739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] PATH_INFO: `/v3/projects/49f9a886e292486692aaccd6824ae703/users/4d793b51fde441afac318ec839730bff/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.827762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f9a886e292486692aaccd6824ae703, user_id=4d793b51fde441afac318ec839730bff, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.830676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:07.842960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:07.848885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 971/1940] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:07 2022] PUT /identity/v3/projects/49f9a886e292486692aaccd6824ae703/users/4d793b51fde441afac318ec839730bff/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:07.849832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:07.860980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.907782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 970/1941] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:07.909754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.910309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.910764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.950452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] MFA Rules not processed for user `4d793b51fde441afac318ec839730bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:07.952045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:07.961118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a3c7-4c8d-4e37-a0aa-6f8f276ad82c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:07.976658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:07.977396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:07.977755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:07.978033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] PATH_INFO: `/v3/projects/881623448d0b4501927e30d86b59b6be` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:07.979218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] RBAC: Authorizing `identity:delete_project(project_id=881623448d0b4501927e30d86b59b6be)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:07.981774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:08.066085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 971/1942] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:08.066085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:08.069306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.074405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881623448d0b4501927e30d86b59b6be', 'request_id': 'req-cea6e965-371e-4181-b976-44ed1d28887d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.081434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881623448d0b4501927e30d86b59b6be', 'request_id': 'req-cea6e965-371e-4181-b976-44ed1d28887d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.093007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881623448d0b4501927e30d86b59b6be', 'request_id': 'req-cea6e965-371e-4181-b976-44ed1d28887d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.114683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] The token cache is being invalidate because project 881623448d0b4501927e30d86b59b6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:08.114979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.117283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.119133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 972/1943] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:07 2022] DELETE /identity/v3/projects/881623448d0b4501927e30d86b59b6be => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:08.122786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:08.126189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.137870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:08.150496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4c702-5a58-46be-9b43-8e632f04c325 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:08.225870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:08.225870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:08.225870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:08.225870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:08.226158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.247161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6e965-371e-4181-b976-44ed1d28887d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:08.251745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:08.252383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:08.252680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:08.253176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] PATH_INFO: `/v3/users/273296c6f55f49f0ac7db3b74121bd84` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:08.253288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:08.254296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=273296c6f55f49f0ac7db3b74121bd84)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:08.256388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:08.287034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:08.288865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:08.299445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 972/1944] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:08.300348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:08.301851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.306131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273296c6f55f49f0ac7db3b74121bd84'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.313466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75fb8-300e-427d-bab2-6e5b66dea427 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:08.315476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273296c6f55f49f0ac7db3b74121bd84'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.316244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273296c6f55f49f0ac7db3b74121bd84'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.317980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:08.318624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:08.318900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:08.319276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:08.321689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.331388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273296c6f55f49f0ac7db3b74121bd84'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.332200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273296c6f55f49f0ac7db3b74121bd84'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.345187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 973/1945] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:08 2022] DELETE /identity/v3/users/273296c6f55f49f0ac7db3b74121bd84 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:08.407859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:08.409611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:08.423284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 973/1946] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:08.690655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:08.692610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.786495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:08.788095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.801514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1f73-ca72-4049-b68e-9f441100cf42 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:08.810333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943170b-0123-4c2a-abe8-1c0256521bb5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:08.814773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:08.815541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:08.815998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:08.816362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] PATH_INFO: `/v3/projects/1d7f367e4bc848d1b4f433bbf12de6f0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:08.818396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7f367e4bc848d1b4f433bbf12de6f0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:08.820823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:08.856226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:08.875038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7f367e4bc848d1b4f433bbf12de6f0', 'request_id': 'req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.875463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:08.876086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:08.876359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:08.876625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:08.878386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.881792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7f367e4bc848d1b4f433bbf12de6f0', 'request_id': 'req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.890687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7f367e4bc848d1b4f433bbf12de6f0', 'request_id': 'req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.901737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] The token cache is being invalidate because project 1d7f367e4bc848d1b4f433bbf12de6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:08.914547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.914547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:08.914547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 974/1947] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:08 2022] DELETE /identity/v3/projects/1d7f367e4bc848d1b4f433bbf12de6f0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:08.914547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:08.914547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:08.941102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:08.942935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:08.952910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 974/1948] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:08.988735 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6551f-4d3f-49ec-ad9b-ec517b341bd1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:08.994158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:08.994833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:08.995133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:08.995551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] PATH_INFO: `/v3/users/e3c4d99e26df4af8be67f972bb1802ad` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:08.996865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c4d99e26df4af8be67f972bb1802ad)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:08.999034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:09.057538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c4d99e26df4af8be67f972bb1802ad'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.070149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c4d99e26df4af8be67f972bb1802ad'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.071446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c4d99e26df4af8be67f972bb1802ad'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.085704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c4d99e26df4af8be67f972bb1802ad'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.086480 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc72213c-b0e9-40d2-8098-08096a222975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c4d99e26df4af8be67f972bb1802ad'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.110391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 975/1949] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:08 2022] DELETE /identity/v3/users/e3c4d99e26df4af8be67f972bb1802ad => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:09.645814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:09.666739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893d125-b3a5-4e44-b295-62ac2431bc3f service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:09.692830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:09.765794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:09.766523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:09.766799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:09.767069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] PATH_INFO: `/v3/projects/238f29be7d7b410790d443044545c850` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:09.768435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=238f29be7d7b410790d443044545c850)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:09.770800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:09.854609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238f29be7d7b410790d443044545c850', 'request_id': 'req-dc046815-9bc3-4564-a18a-06b2c41d3c6b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.862872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238f29be7d7b410790d443044545c850', 'request_id': 'req-dc046815-9bc3-4564-a18a-06b2c41d3c6b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.882919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238f29be7d7b410790d443044545c850', 'request_id': 'req-dc046815-9bc3-4564-a18a-06b2c41d3c6b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.885242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] The token cache is being invalidate because project 238f29be7d7b410790d443044545c850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:09.885779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.886619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc046815-9bc3-4564-a18a-06b2c41d3c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:09.888235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 975/1950] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:09 2022] DELETE /identity/v3/projects/238f29be7d7b410790d443044545c850 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:09.894586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a72d-0c95-4137-85bc-cba4e4f1e99c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:09.894869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a72d-0c95-4137-85bc-cba4e4f1e99c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:09.895136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a72d-0c95-4137-85bc-cba4e4f1e99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:09.938672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-eb54a72d-0c95-4137-85bc-cba4e4f1e99c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:09.940409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb54a72d-0c95-4137-85bc-cba4e4f1e99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:09.977850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:10.018652 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 976/1951] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:10.027719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c3dba-32eb-4605-a7b0-c71fb4b99897 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.028071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c3dba-32eb-4605-a7b0-c71fb4b99897 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.028277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c3dba-32eb-4605-a7b0-c71fb4b99897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.050787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6f1c3dba-32eb-4605-a7b0-c71fb4b99897 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:10.052078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f1c3dba-32eb-4605-a7b0-c71fb4b99897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:10.061466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 976/1952] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:10.066494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54a72d-0c95-4137-85bc-cba4e4f1e99c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.080423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54a72d-0c95-4137-85bc-cba4e4f1e99c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.085063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.085744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.086267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.086428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.087272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:10.087573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.089305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.118128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 977/1953] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:10.122169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c3dba-32eb-4605-a7b0-c71fb4b99897 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.134696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c3dba-32eb-4605-a7b0-c71fb4b99897 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.143240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.143858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.144134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.144496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.145129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.147301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.187121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 977/1954] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:10 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:10.188398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.204551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572e90-95a5-47c2-ab36-4212c58e0cd6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.283177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.283925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.284325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.284696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.285504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.288888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.331895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 978/1955] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:10 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:10.336706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.352939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc638c-9da1-49de-ad8e-5a7d31703382 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.358455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.359337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.359711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.360038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.361191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.362760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.377419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 978/1956] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:10.379942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.391832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400d11-ec26-4cf0-864a-4dd35101db36 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.396637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51d765-270f-43ab-99bb-05c8f76597a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.397664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51d765-270f-43ab-99bb-05c8f76597a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.397975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51d765-270f-43ab-99bb-05c8f76597a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.398249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51d765-270f-43ab-99bb-05c8f76597a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.398901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51d765-270f-43ab-99bb-05c8f76597a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.400626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51d765-270f-43ab-99bb-05c8f76597a2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.413800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 979/1957] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:10.419150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.430453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c9248-e38e-4fe7-bec2-3a4c5a1892bc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.435969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.436770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.437046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.437399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] PATH_INFO: `/v3/projects/78001459f0c041ecad08e3a7571d5fca/users/0e38f33d379d4fbaa874a78515a8d927/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.454625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78001459f0c041ecad08e3a7571d5fca, user_id=0e38f33d379d4fbaa874a78515a8d927, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.458096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.474988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 979/1958] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:10 2022] PUT /identity/v3/projects/78001459f0c041ecad08e3a7571d5fca/users/0e38f33d379d4fbaa874a78515a8d927/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:10.489305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf13ce-6361-4b0f-b97b-721458650a47 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.489953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf13ce-6361-4b0f-b97b-721458650a47 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.490390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf13ce-6361-4b0f-b97b-721458650a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.528166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0fbf13ce-6361-4b0f-b97b-721458650a47 None None] MFA Rules not processed for user `0e38f33d379d4fbaa874a78515a8d927`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:10.530654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0fbf13ce-6361-4b0f-b97b-721458650a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:10.633548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 980/1959] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:10.638056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.701761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:10.726425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54df57e-8451-46b1-ab4c-5b096d012c1b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.733814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.734799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.735015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.735636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.737044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.743418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.786166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 980/1960] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:10 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:10.791160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf13ce-6361-4b0f-b97b-721458650a47 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.809267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf13ce-6361-4b0f-b97b-721458650a47 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.851028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:10.893276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.894111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.894418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.894750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.895471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.897600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.926512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 981/1961] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:10 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:10.930517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.942171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dfe58-cf32-428f-9813-588a18b04fcb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.948175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.948851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.949136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.949442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:10.950105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:10.951927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:10.969580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 981/1962] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:10.971229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:10.983378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a6f26-9669-4a0f-b67a-758b8d67e046 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:10.997166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:10.998043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:10.998446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:10.999037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] PATH_INFO: `/v3/projects/63cc731cf2254da4bbd4346a2fb58bfe/users/fce64229fee54b8a9a2c2df57ad1abbc/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:11.021558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cc731cf2254da4bbd4346a2fb58bfe, user_id=fce64229fee54b8a9a2c2df57ad1abbc, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:11.025649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:11.053624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 982/1963] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:10 2022] PUT /identity/v3/projects/63cc731cf2254da4bbd4346a2fb58bfe/users/fce64229fee54b8a9a2c2df57ad1abbc/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:11.058005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:11.071599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a3dd6-0e68-492f-8d4e-534bba4b9a8f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:11.165698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7cf1e-7bc6-4187-a3df-a6129d6c0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:11.166497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7cf1e-7bc6-4187-a3df-a6129d6c0812 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:11.166898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7cf1e-7bc6-4187-a3df-a6129d6c0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:11.167262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7cf1e-7bc6-4187-a3df-a6129d6c0812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:11.168622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7cf1e-7bc6-4187-a3df-a6129d6c0812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:11.170402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7cf1e-7bc6-4187-a3df-a6129d6c0812 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:11.183765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 982/1964] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:11.188576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:11.201457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f025d-6251-49fb-b6f5-99e75a7c3d86 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:11.207665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:11.209206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:11.209612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:11.210034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] PATH_INFO: `/v3/projects/63cc731cf2254da4bbd4346a2fb58bfe/users/fce64229fee54b8a9a2c2df57ad1abbc/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:11.212167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cc731cf2254da4bbd4346a2fb58bfe, user_id=fce64229fee54b8a9a2c2df57ad1abbc, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:11.216492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:11.232923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 983/1965] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:11 2022] PUT /identity/v3/projects/63cc731cf2254da4bbd4346a2fb58bfe/users/fce64229fee54b8a9a2c2df57ad1abbc/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:11.244689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:11.245693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:11.245693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:11.290966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] MFA Rules not processed for user `fce64229fee54b8a9a2c2df57ad1abbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:11.292541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:11.343274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:11.345655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:11.462642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a86b8-304b-448f-b2d9-8d30a2df255a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:11.467943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:11.468847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:11.469170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:11.469549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] PATH_INFO: `/v3/users/581bbbcd858d42f89a901b49aa90438d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:11.470901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581bbbcd858d42f89a901b49aa90438d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:11.473474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:11.499862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 983/1966] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:11.550804 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:11.552453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:11.559580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581bbbcd858d42f89a901b49aa90438d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:11.572940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581bbbcd858d42f89a901b49aa90438d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:11.573930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581bbbcd858d42f89a901b49aa90438d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:11.625587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:11.643201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581bbbcd858d42f89a901b49aa90438d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:11.644382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2c3df7be-6ee0-4d10-9a1e-87699df47848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581bbbcd858d42f89a901b49aa90438d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:11.659365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:11.665412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 984/1967] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:11 2022] DELETE /identity/v3/users/581bbbcd858d42f89a901b49aa90438d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:11.666446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fa323-8e3d-4425-80a2-dfc094b30a07 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:11.671634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:11.672298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:11.672958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:11.725419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:11.732065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:11.755814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:11.756424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:11.756900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:11.757218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:11.761173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:11.871401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 985/1968] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:11.887512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:11.889219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:11.903075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 984/1969] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:11.932366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:11.934485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.012639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:12.020073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.043200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08b6f-cca6-4510-a989-554774d287aa service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.050312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20488-2a30-46e1-800a-25325bf61fc6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.055345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.056130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.056345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.056619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] PATH_INFO: `/v3/users/f7326dbe6fb74e1a8c8908b9a8e829a3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.059166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7326dbe6fb74e1a8c8908b9a8e829a3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.060327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bb570-1166-4930-b7f0-7eecc5489b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.061112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb570-1166-4930-b7f0-7eecc5489b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.061405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb570-1166-4930-b7f0-7eecc5489b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.061673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb570-1166-4930-b7f0-7eecc5489b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.064088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.088768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bb570-1166-4930-b7f0-7eecc5489b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.090212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bb570-1166-4930-b7f0-7eecc5489b2c service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.110941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 986/1970] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:12.162352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7326dbe6fb74e1a8c8908b9a8e829a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.176315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7326dbe6fb74e1a8c8908b9a8e829a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.203424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7326dbe6fb74e1a8c8908b9a8e829a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.204399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7326dbe6fb74e1a8c8908b9a8e829a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.205207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7326dbe6fb74e1a8c8908b9a8e829a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.225522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 985/1971] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:12 2022] DELETE /identity/v3/users/f7326dbe6fb74e1a8c8908b9a8e829a3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:12.230129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.230434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.230743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.258292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:12.259599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.381102 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:12.383468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.400543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 987/1972] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:12.402310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:12.403953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.410505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:12.422626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a856-020d-49ec-8bf1-798d656b4e1d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.433193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.434144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.434424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.434697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] PATH_INFO: `/v3/users/fa535e7f715a4c6c986e2804701d76a2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.437044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa535e7f715a4c6c986e2804701d76a2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.439371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.489449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba212-ccc9-4553-b003-2c4c92c3c814 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.504560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.507022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.507480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.507760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] PATH_INFO: `/v3/users/0e38f33d379d4fbaa874a78515a8d927` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.509128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e38f33d379d4fbaa874a78515a8d927)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.511225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.524474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:12.532555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa535e7f715a4c6c986e2804701d76a2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.551623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa535e7f715a4c6c986e2804701d76a2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.552641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa535e7f715a4c6c986e2804701d76a2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.588349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa535e7f715a4c6c986e2804701d76a2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.591311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa535e7f715a4c6c986e2804701d76a2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.617150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 988/1973] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:12 2022] DELETE /identity/v3/users/fa535e7f715a4c6c986e2804701d76a2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:12.617150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:12.619113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.623907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e38f33d379d4fbaa874a78515a8d927'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.637135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e38f33d379d4fbaa874a78515a8d927'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.658679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e38f33d379d4fbaa874a78515a8d927'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.659508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e38f33d379d4fbaa874a78515a8d927'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.660225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d879ea22-f310-45f7-8870-2e352d24d545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e38f33d379d4fbaa874a78515a8d927'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.674927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 986/1974] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:12 2022] DELETE /identity/v3/users/0e38f33d379d4fbaa874a78515a8d927 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:12.676264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2ffa-bcca-42f9-b5ed-bb9133321846 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.676649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2ffa-bcca-42f9-b5ed-bb9133321846 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.677016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2ffa-bcca-42f9-b5ed-bb9133321846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.698584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7b57a-c32e-430a-a9d3-d9f212ebb5d6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.699063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-03dd2ffa-bcca-42f9-b5ed-bb9133321846 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:12.700161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03dd2ffa-bcca-42f9-b5ed-bb9133321846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.763599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.764687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.765091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.765393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.767133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.771589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 987/1975] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:12.776285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.776578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.776846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.782050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.784426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.796728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 989/1976] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:12.797783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:12.799433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.806211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:12.809492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.814063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc493ab-2f2a-41b0-b5ab-301e5b5f8a90 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.819259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 988/1977] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:12.821639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.822698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.823093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.823374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.834162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:12.835244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.837165 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.838116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.848869 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 990/1978] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:12.850128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:12.852333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:12.866714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a20378-62e5-4993-b5aa-8da3807cf6f4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.872065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.872917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.873264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.873662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.885802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63c63-9315-45d3-9bf4-632e6b3b3a50 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:12.891430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:12.892080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:12.892365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:12.892642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] PATH_INFO: `/v3/projects/cb757e381c864198b465706584ff0978` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:12.893830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb757e381c864198b465706584ff0978)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.896011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.898538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:12.901942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:12.918426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 989/1979] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:12.963185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb757e381c864198b465706584ff0978', 'request_id': 'req-b4df388f-1fad-453c-9bd3-62e1cb26472c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.976914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb757e381c864198b465706584ff0978', 'request_id': 'req-b4df388f-1fad-453c-9bd3-62e1cb26472c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:12.981575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:12.995645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb757e381c864198b465706584ff0978', 'request_id': 'req-b4df388f-1fad-453c-9bd3-62e1cb26472c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.054448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] The token cache is being invalidate because project cb757e381c864198b465706584ff0978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:13.055045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.056931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.064885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 991/1980] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:12 2022] DELETE /identity/v3/projects/cb757e381c864198b465706584ff0978 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:13.066026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:13.089707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b89d-54be-43d9-8b2a-a16c1709b3db service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:13.108606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:13.225099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:13.226368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:13.226857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:13.227365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] PATH_INFO: `/v3/users/930bcb81b8444e28a060acccd5289dc8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:13.228821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=930bcb81b8444e28a060acccd5289dc8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:13.231398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:13.347971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930bcb81b8444e28a060acccd5289dc8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.367253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930bcb81b8444e28a060acccd5289dc8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.397760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930bcb81b8444e28a060acccd5289dc8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.399676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930bcb81b8444e28a060acccd5289dc8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.402372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930bcb81b8444e28a060acccd5289dc8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:13.426921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 990/1981] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:13 2022] DELETE /identity/v3/users/930bcb81b8444e28a060acccd5289dc8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:13.813534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:13.815797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:13.829666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:13.831697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:13.837747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df388f-1fad-453c-9bd3-62e1cb26472c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:13.933923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:13.934552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:13.934841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:13.935119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] PATH_INFO: `/v3/projects/78001459f0c041ecad08e3a7571d5fca` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:13.936285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=78001459f0c041ecad08e3a7571d5fca)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:13.938407 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:14.013097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78001459f0c041ecad08e3a7571d5fca', 'request_id': 'req-47408849-803b-40fb-b52d-6e498e774ffb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.028073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78001459f0c041ecad08e3a7571d5fca', 'request_id': 'req-47408849-803b-40fb-b52d-6e498e774ffb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.038636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83416-d7ab-4478-ac88-6b6d182cad84 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:14.042700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78001459f0c041ecad08e3a7571d5fca', 'request_id': 'req-47408849-803b-40fb-b52d-6e498e774ffb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.065081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] The token cache is being invalidate because project 78001459f0c041ecad08e3a7571d5fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:14.065727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.066092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.069418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 992/1982] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:13 2022] DELETE /identity/v3/projects/78001459f0c041ecad08e3a7571d5fca => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:14.074052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:14.085961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:14.104108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:14.139800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:14.140542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:14.140821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:14.141142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] PATH_INFO: `/v3/projects/e405b4cd4a544e8fa6680fca3703f5fb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:14.142357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e405b4cd4a544e8fa6680fca3703f5fb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:14.144297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:14.205732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e405b4cd4a544e8fa6680fca3703f5fb', 'request_id': 'req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.212750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e405b4cd4a544e8fa6680fca3703f5fb', 'request_id': 'req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.230486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47408849-803b-40fb-b52d-6e498e774ffb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:14.237603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e405b4cd4a544e8fa6680fca3703f5fb', 'request_id': 'req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.257883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:14.260449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] The token cache is being invalidate because project e405b4cd4a544e8fa6680fca3703f5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:14.261299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.262930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.268534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 991/1983] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:13 2022] DELETE /identity/v3/projects/e405b4cd4a544e8fa6680fca3703f5fb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:14.273689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:14.275298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:14.319745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:14.320599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:14.321016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:14.321358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] PATH_INFO: `/v3/projects/f612fe0021914a85af2cfb5a18de048d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:14.322659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f612fe0021914a85af2cfb5a18de048d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:14.325294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:14.375724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa1e3c-2e1a-49eb-9e5a-c11cf81bcd87 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:14.392712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f612fe0021914a85af2cfb5a18de048d', 'request_id': 'req-61219def-9eea-4f1f-96d6-aec4003a5603'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.401575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f612fe0021914a85af2cfb5a18de048d', 'request_id': 'req-61219def-9eea-4f1f-96d6-aec4003a5603'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.415106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f612fe0021914a85af2cfb5a18de048d', 'request_id': 'req-61219def-9eea-4f1f-96d6-aec4003a5603'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.432156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] The token cache is being invalidate because project f612fe0021914a85af2cfb5a18de048d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:14.433093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.433807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.438830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 993/1984] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:14 2022] DELETE /identity/v3/projects/f612fe0021914a85af2cfb5a18de048d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:14.439726 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:14.442471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:14.495594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:14.496644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:14.497271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:14.497825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] PATH_INFO: `/v3/users/fce64229fee54b8a9a2c2df57ad1abbc` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:14.499578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce64229fee54b8a9a2c2df57ad1abbc)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:14.501836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:14.533828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:14.556108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219def-9eea-4f1f-96d6-aec4003a5603 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:14.562621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:14.563347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:14.563775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:14.567043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] PATH_INFO: `/v3/projects/bc7fa387e7784304ae53ace0317c2c6d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:14.573827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7fa387e7784304ae53ace0317c2c6d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:14.575762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:14.590060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce64229fee54b8a9a2c2df57ad1abbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.602327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce64229fee54b8a9a2c2df57ad1abbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.648010 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce64229fee54b8a9a2c2df57ad1abbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.648900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce64229fee54b8a9a2c2df57ad1abbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.651195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce64229fee54b8a9a2c2df57ad1abbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.680236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 992/1985] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:14 2022] DELETE /identity/v3/users/fce64229fee54b8a9a2c2df57ad1abbc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:14.681914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:14.683904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:14.713902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7fa387e7784304ae53ace0317c2c6d', 'request_id': 'req-03eed0c1-947a-423b-9f98-e79f2bc623b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.727197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7fa387e7784304ae53ace0317c2c6d', 'request_id': 'req-03eed0c1-947a-423b-9f98-e79f2bc623b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.731278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:14.748850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7fa387e7784304ae53ace0317c2c6d', 'request_id': 'req-03eed0c1-947a-423b-9f98-e79f2bc623b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.775185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] The token cache is being invalidate because project bc7fa387e7784304ae53ace0317c2c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:14.776221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.778228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:14.781588 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 994/1986] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:14 2022] DELETE /identity/v3/projects/bc7fa387e7784304ae53ace0317c2c6d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:14.787977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:14.790152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:14.832273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb878a-53d5-48b6-a319-4a5f7b66e30e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:14.858189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:14.858846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:14.859126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:14.859397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] PATH_INFO: `/v3/users/9991df1c8c4d4e0a91e0f8b3ed732234` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:14.862603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9991df1c8c4d4e0a91e0f8b3ed732234)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:14.864425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:14.920973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed0c1-947a-423b-9f98-e79f2bc623b2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:14.931257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:14.932283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:14.933221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:14.933789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] PATH_INFO: `/v3/users/4d793b51fde441afac318ec839730bff` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:14.935444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d793b51fde441afac318ec839730bff)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:14.937752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:14.975018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9991df1c8c4d4e0a91e0f8b3ed732234'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.012307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9991df1c8c4d4e0a91e0f8b3ed732234'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.038800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9991df1c8c4d4e0a91e0f8b3ed732234'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.044313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9991df1c8c4d4e0a91e0f8b3ed732234'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.044639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4302c02a-6685-4ae6-9120-ee6765917c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9991df1c8c4d4e0a91e0f8b3ed732234'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.048212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d793b51fde441afac318ec839730bff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.062376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 993/1987] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:14 2022] DELETE /identity/v3/users/9991df1c8c4d4e0a91e0f8b3ed732234 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:15.062876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d793b51fde441afac318ec839730bff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.064222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.064615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.065001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.071349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d793b51fde441afac318ec839730bff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.105333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d793b51fde441afac318ec839730bff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.106582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79aebdbd-de54-42f4-a52d-52212ff973ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d793b51fde441afac318ec839730bff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.108099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.109340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.130988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 995/1988] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:14 2022] DELETE /identity/v3/users/4d793b51fde441afac318ec839730bff => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:15.138060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:15.213927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 994/1989] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:15.223166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaf2a2-9c40-40ac-aa6c-a75c04956d90 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.223449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaf2a2-9c40-40ac-aa6c-a75c04956d90 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.223723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaf2a2-9c40-40ac-aa6c-a75c04956d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.232673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.234246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.250716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f7eaf2a2-9c40-40ac-aa6c-a75c04956d90 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.252596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f7eaf2a2-9c40-40ac-aa6c-a75c04956d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.262817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc0c4-df6a-4017-b824-ecbf16bf5f9c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.383331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.384180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.384472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 996/1990] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:15.385797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.386083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] PATH_INFO: `/v3/projects/63cc731cf2254da4bbd4346a2fb58bfe` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.388366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaf2a2-9c40-40ac-aa6c-a75c04956d90 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.389755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cc731cf2254da4bbd4346a2fb58bfe)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.395842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.397501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:15.404815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaf2a2-9c40-40ac-aa6c-a75c04956d90 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.411866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.413121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.413591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.414243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.415073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:15.415663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.417969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.431826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 997/1991] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:15.435042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.447565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6436b-3d33-4982-8d48-015e86ce89d1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.452775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.453779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.454282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.454744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.455571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.457900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.466461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cc731cf2254da4bbd4346a2fb58bfe', 'request_id': 'req-9069a829-9a47-4970-b4c0-619f7f1bbe74'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.473675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cc731cf2254da4bbd4346a2fb58bfe', 'request_id': 'req-9069a829-9a47-4970-b4c0-619f7f1bbe74'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.487000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cc731cf2254da4bbd4346a2fb58bfe', 'request_id': 'req-9069a829-9a47-4970-b4c0-619f7f1bbe74'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.495264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 998/1992] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:15.501712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.506021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] The token cache is being invalidate because project 63cc731cf2254da4bbd4346a2fb58bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:15.506568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.507751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.510437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 995/1993] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:15 2022] DELETE /identity/v3/projects/63cc731cf2254da4bbd4346a2fb58bfe => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:15.512828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.514655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.587924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae945fd-e37b-4ce1-a515-e7f7c04e799b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.592642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0013a8-458a-4499-a3f8-289c0e0906c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.593265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0013a8-458a-4499-a3f8-289c0e0906c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.593578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0013a8-458a-4499-a3f8-289c0e0906c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.593851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0013a8-458a-4499-a3f8-289c0e0906c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.594486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0013a8-458a-4499-a3f8-289c0e0906c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.596753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0013a8-458a-4499-a3f8-289c0e0906c5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.603032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:15.623130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 999/1994] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:15.624810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.625240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.625976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.628579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a829-9a47-4970-b4c0-619f7f1bbe74 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.633507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.634155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.634440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.634714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] PATH_INFO: `/v3/projects/4fbb06782d6c43698700e2682c9da6b7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.635847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbb06782d6c43698700e2682c9da6b7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.637821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.646420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.647800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.655598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1000/1995] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:15.656399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.657716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.670856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda724-a00b-49c5-9690-a4d01bdf409e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.675405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.676040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.676314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.676577 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] PATH_INFO: `/v3/projects/49f9a886e292486692aaccd6824ae703` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.677699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f9a886e292486692aaccd6824ae703)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.679763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.687484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbb06782d6c43698700e2682c9da6b7', 'request_id': 'req-02465f5f-7dba-4542-b0d3-68fab4568b64'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.694373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbb06782d6c43698700e2682c9da6b7', 'request_id': 'req-02465f5f-7dba-4542-b0d3-68fab4568b64'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.703303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbb06782d6c43698700e2682c9da6b7', 'request_id': 'req-02465f5f-7dba-4542-b0d3-68fab4568b64'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.714787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] The token cache is being invalidate because project 4fbb06782d6c43698700e2682c9da6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:15.715075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.715716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.717265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 996/1996] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:15 2022] DELETE /identity/v3/projects/4fbb06782d6c43698700e2682c9da6b7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:15.720625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.720845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.733332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f9a886e292486692aaccd6824ae703', 'request_id': 'req-8bf356f0-7cd1-423b-9a31-97ffefa8684e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.739615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f9a886e292486692aaccd6824ae703', 'request_id': 'req-8bf356f0-7cd1-423b-9a31-97ffefa8684e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.748568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f9a886e292486692aaccd6824ae703', 'request_id': 'req-8bf356f0-7cd1-423b-9a31-97ffefa8684e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.759592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] The token cache is being invalidate because project 49f9a886e292486692aaccd6824ae703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:15.759999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.760638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8bf356f0-7cd1-423b-9a31-97ffefa8684e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:15.762185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1001/1997] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:15 2022] DELETE /identity/v3/projects/49f9a886e292486692aaccd6824ae703 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:15.763369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a80a-921f-4710-939a-68b8d2e8e3cc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.763644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a80a-921f-4710-939a-68b8d2e8e3cc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.764036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a80a-921f-4710-939a-68b8d2e8e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.783472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9f90a80a-921f-4710-939a-68b8d2e8e3cc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.784688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9f90a80a-921f-4710-939a-68b8d2e8e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.788294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02465f5f-7dba-4542-b0d3-68fab4568b64 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.817718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:15.850486 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67633b35-330e-47ce-a8eb-1d4f34b8db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.851101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67633b35-330e-47ce-a8eb-1d4f34b8db2b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.851374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67633b35-330e-47ce-a8eb-1d4f34b8db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.851776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67633b35-330e-47ce-a8eb-1d4f34b8db2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.852431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67633b35-330e-47ce-a8eb-1d4f34b8db2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.854165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67633b35-330e-47ce-a8eb-1d4f34b8db2b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.855669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1002/1998] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:15.860229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.860529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.860784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.868196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 997/1999] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:15.868196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546fd20-a62e-4213-adc3-54fa17d62839 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.868196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546fd20-a62e-4213-adc3-54fa17d62839 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.868196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546fd20-a62e-4213-adc3-54fa17d62839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.883918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.885139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.887058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3546fd20-a62e-4213-adc3-54fa17d62839 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.888236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3546fd20-a62e-4213-adc3-54fa17d62839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.902780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 998/2000] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:15.902780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546fd20-a62e-4213-adc3-54fa17d62839 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.903097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1003/2001] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:15.903097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.903641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.910954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546fd20-a62e-4213-adc3-54fa17d62839 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.915729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572aca45-a9af-478d-88f2-6ed337643597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.916348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aca45-a9af-478d-88f2-6ed337643597 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.916626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aca45-a9af-478d-88f2-6ed337643597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.916757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51979-0591-4e57-b32a-6ccf9a78e40f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.917587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aca45-a9af-478d-88f2-6ed337643597 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.917587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aca45-a9af-478d-88f2-6ed337643597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:15.917867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aca45-a9af-478d-88f2-6ed337643597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.919917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aca45-a9af-478d-88f2-6ed337643597 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.921579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcc627-59fe-472a-b229-372f7d6534c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.922384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcc627-59fe-472a-b229-372f7d6534c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.922560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcc627-59fe-472a-b229-372f7d6534c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.923171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcc627-59fe-472a-b229-372f7d6534c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.923464 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcc627-59fe-472a-b229-372f7d6534c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.925742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcc627-59fe-472a-b229-372f7d6534c5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.932375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 999/2002] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:15.933706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315d662-78b9-4d46-a897-cab7d8b6a5bb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.933993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315d662-78b9-4d46-a897-cab7d8b6a5bb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.934265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315d662-78b9-4d46-a897-cab7d8b6a5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.937460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1004/2003] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:15.938801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743dbb1-52b0-4b6d-a8c5-acefffa9f899 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.939088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743dbb1-52b0-4b6d-a8c5-acefffa9f899 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.939637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743dbb1-52b0-4b6d-a8c5-acefffa9f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.945991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:15.960082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7743dbb1-52b0-4b6d-a8c5-acefffa9f899 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.961283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7743dbb1-52b0-4b6d-a8c5-acefffa9f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.969163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1005/2004] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:15.970083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743dbb1-52b0-4b6d-a8c5-acefffa9f899 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.971007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5315d662-78b9-4d46-a897-cab7d8b6a5bb None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:15.972225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5315d662-78b9-4d46-a897-cab7d8b6a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:15.980383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1000/2005] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:15.980383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315d662-78b9-4d46-a897-cab7d8b6a5bb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:15.983683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743dbb1-52b0-4b6d-a8c5-acefffa9f899 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.986304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.986897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.987176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.987450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:15.988075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:15.990050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:15.993095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315d662-78b9-4d46-a897-cab7d8b6a5bb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:15.997966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:15.998610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:15.998885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:15.999155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] PATH_INFO: `/v3/projects/11295c6e01564793b26eeddfb2122894/users/93dfcce68af441a995cd62c31339edca/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.013947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11295c6e01564793b26eeddfb2122894, user_id=93dfcce68af441a995cd62c31339edca, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.016576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.019109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1006/2006] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:15 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:16.020113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.034008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1001/2007] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:15 2022] PUT /identity/v3/projects/11295c6e01564793b26eeddfb2122894/users/93dfcce68af441a995cd62c31339edca/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:16.042616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.083274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488a3e-74c5-4fec-95dc-a85134d62685 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.108126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f07ef-2968-40a9-ac8d-752d15994440 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.114468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.115095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.115371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.115671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.116630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:16.116764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.118492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.134684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1002/2008] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:16.135525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.146644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab77a-39b4-4d46-9875-b8c17bb3d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.147420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab77a-39b4-4d46-9875-b8c17bb3d874 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.147529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196262-0242-4dbc-937b-5e1536fc3ce6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.147760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab77a-39b4-4d46-9875-b8c17bb3d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.148178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab77a-39b4-4d46-9875-b8c17bb3d874 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.148977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab77a-39b4-4d46-9875-b8c17bb3d874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:16.149221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab77a-39b4-4d46-9875-b8c17bb3d874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.150974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab77a-39b4-4d46-9875-b8c17bb3d874 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.152697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.153304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.153633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.153912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.154541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.157076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.164324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1007/2009] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:16.165617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20f16-52ac-406e-8b52-64395f5487ea None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.165903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20f16-52ac-406e-8b52-64395f5487ea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.166180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20f16-52ac-406e-8b52-64395f5487ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.183349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1003/2010] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:16.184386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.196408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9af20f16-52ac-406e-8b52-64395f5487ea None None] MFA Rules not processed for user `93dfcce68af441a995cd62c31339edca`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:16.197678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9af20f16-52ac-406e-8b52-64395f5487ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:16.199015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fd21c-b57b-4bd9-acda-2a5cef8bbc4b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.203888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.204604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.204942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.205166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.205877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.208052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.218950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:16.245455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1004/2011] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:16.246334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.288321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1008/2012] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:16.289573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20f16-52ac-406e-8b52-64395f5487ea None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.307522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20f16-52ac-406e-8b52-64395f5487ea None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.322222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1f6a-c0b9-497e-a690-12df8757eab1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.326893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.327701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.327852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.328120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.328747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.330670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.364743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1005/2013] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:16.365905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.374789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.375798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.376373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.377020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.377933 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.380099 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.383875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:16.401542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1009/2014] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:16.402848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.404885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:16.455658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb587-114b-4511-a489-8bb7f0fcc6b5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.463733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.464582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.464905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.465140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.465806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.467813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.477984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234777c-0778-4bc9-bd23-2ee747d4bfc6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.493540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1006/2015] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:16.495370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.510429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675146f7-193a-4f6c-89d8-458d6fdca62a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.516023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.516474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.516746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.517041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.518114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.520081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.539979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.540700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.541044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.541429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.545141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1007/2016] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:16.545141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.552788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12162a-b1b8-42b3-98b3-d2bba0bf2c67 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.557900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.558502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.558783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.559056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.559704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.561400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.567027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:16.576336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1008/2017] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:16.576336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.583782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349f30d-e522-407f-a3ba-5d5c7b1bdd6f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.588354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.588943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.589217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.589522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.590155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.591751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.601857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.602058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1009/2018] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:16.602862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.606444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.612333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b9f1f-98e0-469a-96c4-c73d4007a862 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.615486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1010/2019] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:16.616431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.623878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.624506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.624880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.625039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.625913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.627529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.633443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a7a8b-8e17-43ca-82fe-5b2161d23ce5 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.638299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.638972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.639252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.639528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] PATH_INFO: `/v3/projects/5a18288d47e444c1a450a07e17103fd5/users/3356fd0db40d46cf9c413383a7ee3777/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.639947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1010/2020] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:16.640963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.652965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f94683-31f8-4728-9c66-fb3422639b1b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.658744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.659434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.659782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.660167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.660901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.662422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.668196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a18288d47e444c1a450a07e17103fd5, user_id=3356fd0db40d46cf9c413383a7ee3777, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.671088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.679429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1011/2021] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:16.680524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.692812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1011/2022] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:16 2022] PUT /identity/v3/projects/5a18288d47e444c1a450a07e17103fd5/users/3356fd0db40d46cf9c413383a7ee3777/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:16.693009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dc1cf-1c9d-4f28-a1d0-9341597dacdc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.694293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.781551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae2b5a-4045-4d5e-9b98-60d91a51d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.782167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2b5a-4045-4d5e-9b98-60d91a51d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.782448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2b5a-4045-4d5e-9b98-60d91a51d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.782878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2b5a-4045-4d5e-9b98-60d91a51d1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.783538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae2b5a-4045-4d5e-9b98-60d91a51d1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.785145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae2b5a-4045-4d5e-9b98-60d91a51d1f4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.796994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1012/2023] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:16.798355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab64d2c-f26f-4cbb-8889-3da61367f5a9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.798640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab64d2c-f26f-4cbb-8889-3da61367f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.798911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab64d2c-f26f-4cbb-8889-3da61367f5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.807238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38a0f7-e981-4ca8-8585-b4d0fbc0e0f5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.813681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.814542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.816479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.816761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] PATH_INFO: `/v3/projects/3e04e5e1352c4d2aa635cc7933162f2c/users/8e427b4b43ac44a08b346a0629595e8d/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.837402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e04e5e1352c4d2aa635cc7933162f2c, user_id=8e427b4b43ac44a08b346a0629595e8d, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:16.838310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5ab64d2c-f26f-4cbb-8889-3da61367f5a9 None None] MFA Rules not processed for user `3356fd0db40d46cf9c413383a7ee3777`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:16.839510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5ab64d2c-f26f-4cbb-8889-3da61367f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:16.840554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:16.860851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1012/2024] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:16 2022] PUT /identity/v3/projects/3e04e5e1352c4d2aa635cc7933162f2c/users/8e427b4b43ac44a08b346a0629595e8d/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:16.871801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:16.881837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:16.949547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1013/2025] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:16.951662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b26f1-61e4-4d5f-9cd0-090fe12a9a15 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.951978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b26f1-61e4-4d5f-9cd0-090fe12a9a15 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.952476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b26f1-61e4-4d5f-9cd0-090fe12a9a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:16.963410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48edfab-4b6b-46d7-99ab-eeeed5e7bc97 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:16.992890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0f0b26f1-61e4-4d5f-9cd0-090fe12a9a15 None None] MFA Rules not processed for user `8e427b4b43ac44a08b346a0629595e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:16.994710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0f0b26f1-61e4-4d5f-9cd0-090fe12a9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:16.995390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:16.996214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:16.996492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:16.996980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] PATH_INFO: `/v3/projects/f9d9cc0801284c8baeedd624e742e058/users/f2335c7f879a420bb2380a1f22b3cbd6/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.026693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d9cc0801284c8baeedd624e742e058, user_id=f2335c7f879a420bb2380a1f22b3cbd6, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.034958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.063068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1013/2026] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:16 2022] PUT /identity/v3/projects/f9d9cc0801284c8baeedd624e742e058/users/f2335c7f879a420bb2380a1f22b3cbd6/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:17.063907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.070082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.088972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:17.120674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1014/2027] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:17.120674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2520-dff6-431f-a86a-b52d921686ff None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.120674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2520-dff6-431f-a86a-b52d921686ff None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.120674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2520-dff6-431f-a86a-b52d921686ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.156985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6d4b2520-dff6-431f-a86a-b52d921686ff None None] MFA Rules not processed for user `f2335c7f879a420bb2380a1f22b3cbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:17.159516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6d4b2520-dff6-431f-a86a-b52d921686ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.167164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd391a3-acfe-4e4b-9e92-c9a303658886 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.172392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.173263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.173716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.174078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.238932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1015/2028] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:17.240213 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b2520-dff6-431f-a86a-b52d921686ff None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.252936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.254796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.271444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1014/2029] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:17.272695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.315937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:17.341407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b2520-dff6-431f-a86a-b52d921686ff None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.346995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.347677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.347989 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.348260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.348947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.350995 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.390247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484760b-e906-4c94-8c6c-8cf6d4354eb8 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.396816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.397477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.397751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.398074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.398783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.400477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1016/2030] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:17 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:17.400824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.404903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.441553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1015/2031] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:17 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:17.443009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.445167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.488950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718db61-75e4-4604-8b60-404f9e643b70 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.504554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:17.533529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f733-3d16-4d91-81c3-dde247d2b0be admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.545504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.547640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.550209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.550528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] PATH_INFO: `/v3/users/1065a63effab45f48d6ffb7d52db4f8b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.552432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1065a63effab45f48d6ffb7d52db4f8b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.554469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.603734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.604517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.604811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.605061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] PATH_INFO: `/v3/users/3356fd0db40d46cf9c413383a7ee3777` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.606534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3356fd0db40d46cf9c413383a7ee3777)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.609015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.643448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1065a63effab45f48d6ffb7d52db4f8b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.655643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1065a63effab45f48d6ffb7d52db4f8b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.656952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1065a63effab45f48d6ffb7d52db4f8b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.673048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3356fd0db40d46cf9c413383a7ee3777'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.677098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1065a63effab45f48d6ffb7d52db4f8b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.678346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1065a63effab45f48d6ffb7d52db4f8b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.683857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3356fd0db40d46cf9c413383a7ee3777'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.702485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3356fd0db40d46cf9c413383a7ee3777'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.702715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1016/2032] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:17 2022] DELETE /identity/v3/users/1065a63effab45f48d6ffb7d52db4f8b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:17.703796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3356fd0db40d46cf9c413383a7ee3777'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.704601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3356fd0db40d46cf9c413383a7ee3777'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:17.706689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.708409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.715530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:17.727411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1017/2033] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:17 2022] DELETE /identity/v3/users/3356fd0db40d46cf9c413383a7ee3777 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:17.730641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.734633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.796417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5087e-4f9f-4f24-9099-6a908d0e91f2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.833859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cab73e-0e73-4eb1-a2a3-7fee4c712ea9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.841973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6eb00-ea06-4e1c-926c-6001fd0370a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.842597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6eb00-ea06-4e1c-926c-6001fd0370a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.843082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6eb00-ea06-4e1c-926c-6001fd0370a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.843268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6eb00-ea06-4e1c-926c-6001fd0370a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.844005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6eb00-ea06-4e1c-926c-6001fd0370a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.845987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6eb00-ea06-4e1c-926c-6001fd0370a1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.860087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b632485-39c2-484b-a652-26fa0e4a00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.861034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b632485-39c2-484b-a652-26fa0e4a00b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.861839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b632485-39c2-484b-a652-26fa0e4a00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.862260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b632485-39c2-484b-a652-26fa0e4a00b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.862928 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b632485-39c2-484b-a652-26fa0e4a00b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.865099 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b632485-39c2-484b-a652-26fa0e4a00b5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.873628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1018/2034] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:17 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:17.873628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba126-e823-4f1c-9778-76a341ea15c2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.873628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba126-e823-4f1c-9778-76a341ea15c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.873628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba126-e823-4f1c-9778-76a341ea15c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.894961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1017/2035] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:17 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:17.894961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.894961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.894961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.895371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-17bba126-e823-4f1c-9778-76a341ea15c2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:17.895813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-17bba126-e823-4f1c-9778-76a341ea15c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.902159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:17.904295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1019/2036] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:17.905235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bba126-e823-4f1c-9778-76a341ea15c2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.916727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bba126-e823-4f1c-9778-76a341ea15c2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.917131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:17.919109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.923012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.923640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.924055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.924286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.925245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.927638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.930979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1018/2037] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:17.931887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.933241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.941616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1020/2038] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:17.941616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.941853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.946006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a7c32-07ae-4d09-a818-8f4dfb146e90 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:17.950732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:17.951411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:17.951692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:17.951960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:17.952608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:17.954282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:17.964329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1019/2039] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:17.965127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:17.966890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:17.998368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872a2a7-4990-41e1-a869-7cc87fb903a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.002056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.002676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.002962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.003233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.012178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.013661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.021488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ea06-216b-4c01-b0da-900d46fae780 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.024883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1021/2040] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:18.025710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.025832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.026404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.026668 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.026944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.035169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45975a1-a0df-4228-95e8-92225316a137 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.036731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.038461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.040534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.041340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.041658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.041936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] PATH_INFO: `/v3/projects/e57a84ba8ffe4fd499f82aaf56e5abed/users/1be37ffbc1b7425b9f405c64aa0da9ff/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.048816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1020/2041] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:18.049562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.059513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484d83-558a-4a9f-9ad7-12664883b8d2 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.067694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.068371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.068632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.068986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] PATH_INFO: `/v3/projects/85390d351a2948e085ac3c835de9a428/users/1bc2d68e731841229ec838edc21c5440/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.072034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57a84ba8ffe4fd499f82aaf56e5abed, user_id=1be37ffbc1b7425b9f405c64aa0da9ff, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.075021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.086889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85390d351a2948e085ac3c835de9a428, user_id=1bc2d68e731841229ec838edc21c5440, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.092093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.094479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1022/2042] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:18 2022] PUT /identity/v3/projects/e57a84ba8ffe4fd499f82aaf56e5abed/users/1be37ffbc1b7425b9f405c64aa0da9ff/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:18.098978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.117448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1021/2043] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:18 2022] PUT /identity/v3/projects/85390d351a2948e085ac3c835de9a428/users/1bc2d68e731841229ec838edc21c5440/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:18.122948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.158681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:18.177636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad4905-1a2d-4cbe-bc6a-41c0e49a95bb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.248306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.249711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.250087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.250577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.251169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.253083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.253517 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52fc0-3347-4d83-93d0-6ee17d58dbb1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.264798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.265599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.265980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.266329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.267134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.269490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.279711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1023/2044] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:18.296171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1022/2045] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:18.299639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.300149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.350298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e66ce-65d2-464c-8fec-0d62e7411d23 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.351329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8f1f-6adf-43d7-9bda-781247c993fb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.365752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa987787-abc2-4d7d-aa6f-f9968c76b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.366829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa987787-abc2-4d7d-aa6f-f9968c76b026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.367131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa987787-abc2-4d7d-aa6f-f9968c76b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.367243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa987787-abc2-4d7d-aa6f-f9968c76b026 admin admin] PATH_INFO: `/v3/projects/85390d351a2948e085ac3c835de9a428/users/1bc2d68e731841229ec838edc21c5440/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.370255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa987787-abc2-4d7d-aa6f-f9968c76b026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85390d351a2948e085ac3c835de9a428, user_id=1bc2d68e731841229ec838edc21c5440, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.371033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad81f0-22f1-45b8-8acf-38d14cc7a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.372017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad81f0-22f1-45b8-8acf-38d14cc7a93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.372484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad81f0-22f1-45b8-8acf-38d14cc7a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.373398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa987787-abc2-4d7d-aa6f-f9968c76b026 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.378752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad81f0-22f1-45b8-8acf-38d14cc7a93b admin admin] PATH_INFO: `/v3/projects/e57a84ba8ffe4fd499f82aaf56e5abed/users/1be37ffbc1b7425b9f405c64aa0da9ff/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.388860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1023/2046] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:18 2022] PUT /identity/v3/projects/85390d351a2948e085ac3c835de9a428/users/1bc2d68e731841229ec838edc21c5440/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:18.400421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.400897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.401829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.407094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad81f0-22f1-45b8-8acf-38d14cc7a93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57a84ba8ffe4fd499f82aaf56e5abed, user_id=1be37ffbc1b7425b9f405c64aa0da9ff, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.415797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad81f0-22f1-45b8-8acf-38d14cc7a93b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.452743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1024/2047] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:18 2022] PUT /identity/v3/projects/e57a84ba8ffe4fd499f82aaf56e5abed/users/1be37ffbc1b7425b9f405c64aa0da9ff/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:18.464880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.466309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.467052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.496971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] MFA Rules not processed for user `1bc2d68e731841229ec838edc21c5440`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:18.498838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:18.536544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] MFA Rules not processed for user `1be37ffbc1b7425b9f405c64aa0da9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:18.537943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:18.547521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:18.643789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1024/2048] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:18.650953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.652767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:18.727596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1025/2049] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:18.728457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.729999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:18.751802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48405674-ddb9-4039-9668-09e93a695d18 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.756636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.757414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.757702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.757971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] PATH_INFO: `/v3/projects/58c33a71055c452fa000c416662d5605` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.759352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c33a71055c452fa000c416662d5605)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.761257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.798022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e400d30-89a3-4af2-ae95-1bfeeb4120dc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.802064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.802703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.803096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.803680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.816320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.818139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.830687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1026/2050] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:18.831682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.833186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:18.835297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c33a71055c452fa000c416662d5605', 'request_id': 'req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.844481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:18.847386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c33a71055c452fa000c416662d5605', 'request_id': 'req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.852546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5113f-0fe2-423a-bc2c-69f08f9d37f9 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.862378 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c33a71055c452fa000c416662d5605', 'request_id': 'req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.900228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] The token cache is being invalidate because project 58c33a71055c452fa000c416662d5605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:18.900499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.901114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.907802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1025/2051] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:18 2022] DELETE /identity/v3/projects/58c33a71055c452fa000c416662d5605 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:18.908686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.913590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:18.954376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.955045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.955327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.955599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] PATH_INFO: `/v3/projects/5a18288d47e444c1a450a07e17103fd5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.957335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a18288d47e444c1a450a07e17103fd5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.959333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.015750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee6d80-5dd1-47f9-b238-8a2ff31f6b6a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.019461 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2124ea-839a-42f4-a864-d2282616a139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.020078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2124ea-839a-42f4-a864-d2282616a139 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.020639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2124ea-839a-42f4-a864-d2282616a139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.020901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2124ea-839a-42f4-a864-d2282616a139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.022854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7c2124ea-839a-42f4-a864-d2282616a139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.042380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:19.049125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a18288d47e444c1a450a07e17103fd5', 'request_id': 'req-01a9df46-e380-49b2-8416-1bc766c5acad'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.057327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a18288d47e444c1a450a07e17103fd5', 'request_id': 'req-01a9df46-e380-49b2-8416-1bc766c5acad'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.067448 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a18288d47e444c1a450a07e17103fd5', 'request_id': 'req-01a9df46-e380-49b2-8416-1bc766c5acad'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.080193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] The token cache is being invalidate because project 5a18288d47e444c1a450a07e17103fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:19.080487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.081188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.082829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1027/2052] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:18 2022] DELETE /identity/v3/projects/5a18288d47e444c1a450a07e17103fd5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:19.086795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.088248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.111052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2124ea-839a-42f4-a864-d2282616a139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.113158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2124ea-839a-42f4-a864-d2282616a139 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.124098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1026/2053] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:19.125400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed326c3a-fb50-4fbc-8d14-db39d2af29e2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.125685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed326c3a-fb50-4fbc-8d14-db39d2af29e2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.125960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed326c3a-fb50-4fbc-8d14-db39d2af29e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.148484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ed326c3a-fb50-4fbc-8d14-db39d2af29e2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:19.149836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed326c3a-fb50-4fbc-8d14-db39d2af29e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.190905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9df46-e380-49b2-8416-1bc766c5acad admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.197489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.199495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.199878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.200186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] PATH_INFO: `/v3/users/767047bbf2694bbf958381e61f227872` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.201422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=767047bbf2694bbf958381e61f227872)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.203455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.237492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1027/2054] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:19.247714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1781a-82d5-4ad7-a165-4f884c6c16db None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.248046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1781a-82d5-4ad7-a165-4f884c6c16db None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.248360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1781a-82d5-4ad7-a165-4f884c6c16db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.258440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:19.269714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767047bbf2694bbf958381e61f227872'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.279100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767047bbf2694bbf958381e61f227872'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.281273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-21a1781a-82d5-4ad7-a165-4f884c6c16db None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:19.284346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-21a1781a-82d5-4ad7-a165-4f884c6c16db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.295075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767047bbf2694bbf958381e61f227872'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.296252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767047bbf2694bbf958381e61f227872'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.296956 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767047bbf2694bbf958381e61f227872'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.306270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1028/2055] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:19.307380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1781a-82d5-4ad7-a165-4f884c6c16db None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.315320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1028/2056] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:19 2022] DELETE /identity/v3/users/767047bbf2694bbf958381e61f227872 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:19.331864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1781a-82d5-4ad7-a165-4f884c6c16db None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.364744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.367048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.424650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.425444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.425872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.426239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.427551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:19.427986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.430583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.452566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1029/2057] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:34:19.455186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.458712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.471572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc990b-7712-4b1b-8893-90649ebb5b4e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.477772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc2d68e731841229ec838edc21c5440', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85390d351a2948e085ac3c835de9a428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.478239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.478525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.478798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.479458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:19.479760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.481144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f56ef-b288-4ad6-b65e-484c6e590591 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.481545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.488563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.490016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.490374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.490710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.491417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.494625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.528854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1029/2058] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:34:19.530456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.551166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda12fd7-9788-4ea2-b5c1-d4aaac5fc478 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.560725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1030/2059] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:19 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:19.563611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc2d68e731841229ec838edc21c5440', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85390d351a2948e085ac3c835de9a428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.564948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.566619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.567770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.568253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.569347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.572489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.610837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:19.636797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1030/2060] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:19 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:19.638982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.679852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9ade9-8877-4c6e-8933-366bc7c57c97 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.719733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7e78f-8a56-4088-a396-f526eb36a1de tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.726390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc2d68e731841229ec838edc21c5440', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85390d351a2948e085ac3c835de9a428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.727271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.727725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.728241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.729054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:19.729536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.731296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.750272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1031/2061] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:34:19.751332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.754159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.784361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.785472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.785950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.786110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:19.786270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.786934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.789583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.818907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1031/2062] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:19 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:19.820081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.832059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d0c7-14db-46a0-9db7-ba9988bf7297 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.838299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc2d68e731841229ec838edc21c5440', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85390d351a2948e085ac3c835de9a428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.838992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.839325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.839542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] PATH_INFO: `/v3/projects/93ec3e8955764e67a795db49dcb9fbe4` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.840872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=93ec3e8955764e67a795db49dcb9fbe4)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.842825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.849238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b0601-8dc3-4c68-869d-9658299c3eea tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.857026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.858046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.858179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.858433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] PATH_INFO: `/v3/projects/453808f8c63b45c2b93582f9e4944676` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.859586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453808f8c63b45c2b93582f9e4944676)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.863175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.904638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ec3e8955764e67a795db49dcb9fbe4', 'request_id': 'req-d526c830-fd2c-4960-ab37-d4f31f3f4e70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.915644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ec3e8955764e67a795db49dcb9fbe4', 'request_id': 'req-d526c830-fd2c-4960-ab37-d4f31f3f4e70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.917620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453808f8c63b45c2b93582f9e4944676', 'request_id': 'req-a524229f-97c6-404c-bf5a-39132a001c58'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.925489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453808f8c63b45c2b93582f9e4944676', 'request_id': 'req-a524229f-97c6-404c-bf5a-39132a001c58'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.929213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ec3e8955764e67a795db49dcb9fbe4', 'request_id': 'req-d526c830-fd2c-4960-ab37-d4f31f3f4e70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.935389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453808f8c63b45c2b93582f9e4944676', 'request_id': 'req-a524229f-97c6-404c-bf5a-39132a001c58'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.941919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] The token cache is being invalidate because project 93ec3e8955764e67a795db49dcb9fbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:19.942697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.943346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.948429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1032/2063] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:19 2022] DELETE /identity/v3/projects/93ec3e8955764e67a795db49dcb9fbe4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:19.948429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.948429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.957326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] The token cache is being invalidate because project 453808f8c63b45c2b93582f9e4944676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:19.958400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.960008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a524229f-97c6-404c-bf5a-39132a001c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.962342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1032/2064] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:19 2022] DELETE /identity/v3/projects/453808f8c63b45c2b93582f9e4944676 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:19.968578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5338-eece-4049-8269-ab6c0a22e47f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.969082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5338-eece-4049-8269-ab6c0a22e47f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.970170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5338-eece-4049-8269-ab6c0a22e47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.994366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8e4b5338-eece-4049-8269-ab6c0a22e47f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:19.998444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8e4b5338-eece-4049-8269-ab6c0a22e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.020026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:20.068966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526c830-fd2c-4960-ab37-d4f31f3f4e70 tempest-VolumeQuotaClassesTest-1574172244 tempest-VolumeQuotaClassesTest-1574172244-project-admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.132905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1033/2065] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:20.141822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6b0d7-c6e9-4533-b855-8ddf2d95bb8b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.142214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6b0d7-c6e9-4533-b855-8ddf2d95bb8b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.142494 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6b0d7-c6e9-4533-b855-8ddf2d95bb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.188734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d9c6b0d7-c6e9-4533-b855-8ddf2d95bb8b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:20.190612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d9c6b0d7-c6e9-4533-b855-8ddf2d95bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.201203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1034/2066] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:20.205923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6b0d7-c6e9-4533-b855-8ddf2d95bb8b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.226322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6b0d7-c6e9-4533-b855-8ddf2d95bb8b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.234415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.235433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.235433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.235674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.236727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.238367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.239960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.240771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.241219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.241578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.242414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:20.242727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.245406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.253818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1033/2067] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:20.258366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.260501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1035/2068] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:34:20.264431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.264802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.279432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15592-a40f-489f-9f50-d73bc053bb83 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.290046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537574ca-ca7d-4b29-893f-b31ecdd70ced admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.290175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.290761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.291108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.291399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.292029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.294209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.295789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.296488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.297065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.297436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.298298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.300057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.314708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1034/2069] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:20.315637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.317756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.332454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b79670-4239-485d-8bb9-cfed49a44131 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.333530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1036/2070] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:20.334611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.346033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:20.396702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.397389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.397673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.397943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] PATH_INFO: `/v3/users/8e427b4b43ac44a08b346a0629595e8d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.399132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e427b4b43ac44a08b346a0629595e8d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.401251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.403630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da08bb9-66fb-4509-8164-54f5dc12e455 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.408326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.408988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.409309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.409612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] PATH_INFO: `/v3/projects/e4e3ca01432b46a0a97329d52b5f9434/users/0c30b16e0dd14a66867b794c3af424a5/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.425621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e3ca01432b46a0a97329d52b5f9434, user_id=0c30b16e0dd14a66867b794c3af424a5, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.428503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.445782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1037/2071] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:20 2022] PUT /identity/v3/projects/e4e3ca01432b46a0a97329d52b5f9434/users/0c30b16e0dd14a66867b794c3af424a5/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:20.446895 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.454069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e427b4b43ac44a08b346a0629595e8d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.463375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e427b4b43ac44a08b346a0629595e8d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.464025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e427b4b43ac44a08b346a0629595e8d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.477916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e427b4b43ac44a08b346a0629595e8d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.478610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f7e06222-c8d6-43fb-9600-9574a5163fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e427b4b43ac44a08b346a0629595e8d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.483086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:20.496269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1035/2072] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:20 2022] DELETE /identity/v3/users/8e427b4b43ac44a08b346a0629595e8d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:20.496269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8c37e-d421-4f08-a635-d3464bfd7b70 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.496269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8c37e-d421-4f08-a635-d3464bfd7b70 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.496269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8c37e-d421-4f08-a635-d3464bfd7b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.523385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693021c5-0995-4305-848c-6e736a76640d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.527013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d2a8c37e-d421-4f08-a635-d3464bfd7b70 None None] MFA Rules not processed for user `0c30b16e0dd14a66867b794c3af424a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:20.528244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d2a8c37e-d421-4f08-a635-d3464bfd7b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.581597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.582214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.582499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.582773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.583577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.586115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.592616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1036/2073] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:20.593895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9904e-9130-40cd-858f-f388144613cf None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.594177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9904e-9130-40cd-858f-f388144613cf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.594447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9904e-9130-40cd-858f-f388144613cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.614608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1038/2074] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:20.615471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.618399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.623757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0de9904e-9130-40cd-858f-f388144613cf None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:20.625719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0de9904e-9130-40cd-858f-f388144613cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.636113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1037/2075] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:20.636789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9904e-9130-40cd-858f-f388144613cf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.648072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0de9904e-9130-40cd-858f-f388144613cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.665278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9904e-9130-40cd-858f-f388144613cf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.670827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.671530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.671873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.672545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.673274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.675026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.675803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:20.689194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1038/2076] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:20.690247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.692362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.708317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61d37-eaad-45f5-835a-f55070a92884 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.715584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.716224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.716788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.717062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.728428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.729905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.739950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1039/2077] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:20.741177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.752704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b890c6-e05b-4fe2-b0fb-c92a21ac6e92 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.757912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.758553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.758828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.759093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.759783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.760794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebc238-f073-4dd0-8a42-4879b6a23aef admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.761395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.768123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56a88b-44af-4d98-85cf-def420ba55d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.769424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a88b-44af-4d98-85cf-def420ba55d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.769916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a88b-44af-4d98-85cf-def420ba55d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.770430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a88b-44af-4d98-85cf-def420ba55d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.772400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1040/2078] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:20.776645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.783076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56a88b-44af-4d98-85cf-def420ba55d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.786050 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56a88b-44af-4d98-85cf-def420ba55d5 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.788371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877acf8-d193-4080-a65e-7529a0d5715c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.793876 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.794702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.795276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.795641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] PATH_INFO: `/v3/projects/bf3de07cc4f648ba8c3f8521a71f69f4/users/7904e9f24c2a4fe8bcd7fe3f7ceee0b7/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.801632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1039/2079] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:20.813044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3de07cc4f648ba8c3f8521a71f69f4, user_id=7904e9f24c2a4fe8bcd7fe3f7ceee0b7, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.821603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.846212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1041/2080] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:20 2022] PUT /identity/v3/projects/bf3de07cc4f648ba8c3f8521a71f69f4/users/7904e9f24c2a4fe8bcd7fe3f7ceee0b7/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:20.856401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276ee7-3ccb-4055-915b-838556a204fb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.856720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276ee7-3ccb-4055-915b-838556a204fb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.857155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276ee7-3ccb-4055-915b-838556a204fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.890358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-44276ee7-3ccb-4055-915b-838556a204fb None None] MFA Rules not processed for user `7904e9f24c2a4fe8bcd7fe3f7ceee0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:20.891631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-44276ee7-3ccb-4055-915b-838556a204fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.958998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:20.966344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1040/2081] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:20.970828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.106231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd0dae-f5d4-4219-8c3b-d8c9d6ec64d2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.112858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.113738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.114154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.114613 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.115572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.117746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.167600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1042/2082] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:21.171776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44276ee7-3ccb-4055-915b-838556a204fb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.183115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44276ee7-3ccb-4055-915b-838556a204fb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.214156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.215946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:21.316007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.318203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.318525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.318844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.321667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.323800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.335641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0906b22-b765-4605-a314-3716b2d415c8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.346957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.347591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.348051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.348158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] PATH_INFO: `/v3/projects/3e04e5e1352c4d2aa635cc7933162f2c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.351457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e04e5e1352c4d2aa635cc7933162f2c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.353430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.378220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1041/2083] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:21 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:21.388172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.397520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:21.403680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18764ac4-cd9d-4c35-a774-e4862c16884e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.410626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.411684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.412163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.412669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.413852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.416810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.433444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1042/2084] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:21.435877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.444758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e04e5e1352c4d2aa635cc7933162f2c', 'request_id': 'req-e8400605-8eb4-43c8-aca7-8397ba03f535'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.450125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889e3f-9783-40fc-bb6c-d65937181f12 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.458305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e04e5e1352c4d2aa635cc7933162f2c', 'request_id': 'req-e8400605-8eb4-43c8-aca7-8397ba03f535'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.470348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e04e5e1352c4d2aa635cc7933162f2c', 'request_id': 'req-e8400605-8eb4-43c8-aca7-8397ba03f535'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.488928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] The token cache is being invalidate because project 3e04e5e1352c4d2aa635cc7933162f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:21.489558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.490615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.493095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1043/2085] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:21 2022] DELETE /identity/v3/projects/3e04e5e1352c4d2aa635cc7933162f2c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:21.499603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.501853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:21.544652 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.546289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.546574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.546842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] PATH_INFO: `/v3/projects/69bc731de5f2454784904a8b49cecf50/users/42ac78319fe54be289f4e973dcd0c6c6/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.570086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bc731de5f2454784904a8b49cecf50, user_id=42ac78319fe54be289f4e973dcd0c6c6, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.573481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.583901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400605-8eb4-43c8-aca7-8397ba03f535 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.588005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1043/2086] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:21 2022] PUT /identity/v3/projects/69bc731de5f2454784904a8b49cecf50/users/42ac78319fe54be289f4e973dcd0c6c6/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:21.592074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.593764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:21.656031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.656976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.657164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.657425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] PATH_INFO: `/v3/users/1bc2d68e731841229ec838edc21c5440` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.658688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc2d68e731841229ec838edc21c5440)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.660666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.687744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aec52-9326-4e5a-9ef2-d85232bee31e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.695692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.696313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.696597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.696871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.697569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.699199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.700778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:21.715387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1044/2087] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:21.719403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.728492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc2d68e731841229ec838edc21c5440'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.730611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd26e8-e67e-4593-9b2b-51180540894c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.736078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf19816-4c65-463b-b3c9-98f0d6c03a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.736845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19816-4c65-463b-b3c9-98f0d6c03a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.737065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19816-4c65-463b-b3c9-98f0d6c03a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.737337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19816-4c65-463b-b3c9-98f0d6c03a7f admin admin] PATH_INFO: `/v3/projects/69bc731de5f2454784904a8b49cecf50/users/42ac78319fe54be289f4e973dcd0c6c6/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.739245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf19816-4c65-463b-b3c9-98f0d6c03a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bc731de5f2454784904a8b49cecf50, user_id=42ac78319fe54be289f4e973dcd0c6c6, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.739626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc2d68e731841229ec838edc21c5440'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.742288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf19816-4c65-463b-b3c9-98f0d6c03a7f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.753753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1045/2088] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:21 2022] PUT /identity/v3/projects/69bc731de5f2454784904a8b49cecf50/users/42ac78319fe54be289f4e973dcd0c6c6/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:21.758551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:21.766182 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.766545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.766896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.777782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc2d68e731841229ec838edc21c5440'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.778558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc2d68e731841229ec838edc21c5440'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.779343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc2d68e731841229ec838edc21c5440'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:21.796817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1044/2089] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:21 2022] DELETE /identity/v3/users/1bc2d68e731841229ec838edc21c5440 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:21.809046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] MFA Rules not processed for user `42ac78319fe54be289f4e973dcd0c6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:21.810418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:21.931939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1046/2090] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:21.945427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.947469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:22.022782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d4df-5f93-4d73-8b5b-d0ef86d2988e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:22.026575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b461f-72fe-4148-b9a5-a11fd3ae58e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:22.027162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b461f-72fe-4148-b9a5-a11fd3ae58e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.027462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b461f-72fe-4148-b9a5-a11fd3ae58e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.027699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b461f-72fe-4148-b9a5-a11fd3ae58e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.036948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b461f-72fe-4148-b9a5-a11fd3ae58e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:22.038647 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b461f-72fe-4148-b9a5-a11fd3ae58e4 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:22.048593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1045/2091] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:22.079526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:22.080997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:22.151435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c984d9-de8f-4548-9c72-078f14034a13 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:22.156539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:22.157479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.157619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.157978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] PATH_INFO: `/v3/users/7904e9f24c2a4fe8bcd7fe3f7ceee0b7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.159320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7904e9f24c2a4fe8bcd7fe3f7ceee0b7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:22.161439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:22.229823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7904e9f24c2a4fe8bcd7fe3f7ceee0b7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.262012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7904e9f24c2a4fe8bcd7fe3f7ceee0b7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.263483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7904e9f24c2a4fe8bcd7fe3f7ceee0b7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.282705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:22.285203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7904e9f24c2a4fe8bcd7fe3f7ceee0b7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.287076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7904e9f24c2a4fe8bcd7fe3f7ceee0b7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.319116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1047/2092] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:22 2022] DELETE /identity/v3/users/7904e9f24c2a4fe8bcd7fe3f7ceee0b7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:22.324485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.325009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.325493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.337614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:22.339175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:22.378340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:22.382946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:22.469008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1046/2093] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:22.481005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:22.484669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:22.504704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cd64e-e307-4633-a70b-a3b8bfb2d86d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:22.512861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:22.515022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.515648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.515648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] PATH_INFO: `/v3/projects/85390d351a2948e085ac3c835de9a428` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.519473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85390d351a2948e085ac3c835de9a428)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:22.524798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:22.580543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b114be8-72b8-4d1e-ae8e-43cac086e087 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:22.586182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fb437-5054-4471-b6a5-4dedd3dbb490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:22.587478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb437-5054-4471-b6a5-4dedd3dbb490 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.587907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb437-5054-4471-b6a5-4dedd3dbb490 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.588322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb437-5054-4471-b6a5-4dedd3dbb490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.603320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fb437-5054-4471-b6a5-4dedd3dbb490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:22.606116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fb437-5054-4471-b6a5-4dedd3dbb490 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:22.636844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1047/2094] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:22.642170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85390d351a2948e085ac3c835de9a428', 'request_id': 'req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.649642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85390d351a2948e085ac3c835de9a428', 'request_id': 'req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.673768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85390d351a2948e085ac3c835de9a428', 'request_id': 'req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.690027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] The token cache is being invalidate because project 85390d351a2948e085ac3c835de9a428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:22.690027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.690866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e8309c4-9f18-4fd8-aa32-a8cf485d37d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:22.694101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1048/2095] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:22 2022] DELETE /identity/v3/projects/85390d351a2948e085ac3c835de9a428 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:22.699451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f086-eb34-42a6-8f80-1dccab4627d4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.699894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f086-eb34-42a6-8f80-1dccab4627d4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.700312 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f086-eb34-42a6-8f80-1dccab4627d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.745671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-44d0f086-eb34-42a6-8f80-1dccab4627d4 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:22.749212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-44d0f086-eb34-42a6-8f80-1dccab4627d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:22.793246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:22.866837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1048/2096] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:22.874318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fdae9-b2b6-49bf-a28e-4ca8e9005782 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.874610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fdae9-b2b6-49bf-a28e-4ca8e9005782 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.874894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fdae9-b2b6-49bf-a28e-4ca8e9005782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.906695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e32fdae9-b2b6-49bf-a28e-4ca8e9005782 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:22.908153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e32fdae9-b2b6-49bf-a28e-4ca8e9005782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:22.917845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1049/2097] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:22.922545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0f086-eb34-42a6-8f80-1dccab4627d4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:22.934657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0f086-eb34-42a6-8f80-1dccab4627d4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:22.941206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:22.941912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.942540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.942807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.943457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:22.943807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:22.946345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:22.962524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1049/2098] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:34:22.967280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fdae9-b2b6-49bf-a28e-4ca8e9005782 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:22.982533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fdae9-b2b6-49bf-a28e-4ca8e9005782 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:22.989524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:22.990586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:22.991337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:22.992033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:22.993534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:22.996701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.052691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1050/2099] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:22 2022] POST /identity/v3/projects => generated 401 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:23.064184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.092831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204828-c285-4eba-a670-9aa29eb88e7b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.099041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.101007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:23.208701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:23.209569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.209776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.210147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.210860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:23.212868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.238355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:23.239751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1050/2100] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:23 2022] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:23.244433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.263826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aeef3-38b4-480c-a09c-83028a263356 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.269316 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:23.270229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.270568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.270901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.271133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab178022-ee34-4b50-a0f6-26d292685005 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.272509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:23.273768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.276656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:23.277520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.277804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.278078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] PATH_INFO: `/v3/projects/bf3de07cc4f648ba8c3f8521a71f69f4` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.279384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3de07cc4f648ba8c3f8521a71f69f4)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:23.281397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.289753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1051/2101] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:23.293423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.309829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb54b1-24f8-478d-807f-fbf4f18b5077 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.314862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:23.315549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.315943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.316219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.317504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:23.319703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.333632 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1052/2102] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:23.338369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.343992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3de07cc4f648ba8c3f8521a71f69f4', 'request_id': 'req-a0aab509-b2d0-4afd-b016-9b723b825c10'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.351484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3de07cc4f648ba8c3f8521a71f69f4', 'request_id': 'req-a0aab509-b2d0-4afd-b016-9b723b825c10'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.351680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1e6e-d488-4e45-8ba8-19cc566dfe26 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.363980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3de07cc4f648ba8c3f8521a71f69f4', 'request_id': 'req-a0aab509-b2d0-4afd-b016-9b723b825c10'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.376106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] The token cache is being invalidate because project bf3de07cc4f648ba8c3f8521a71f69f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:23.376619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.377301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.379362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1051/2103] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:23 2022] DELETE /identity/v3/projects/bf3de07cc4f648ba8c3f8521a71f69f4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:23.383593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.385302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:23.415537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c090ef-53a9-417c-9e63-a53fbbec87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:23.416319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c090ef-53a9-417c-9e63-a53fbbec87b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.416667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c090ef-53a9-417c-9e63-a53fbbec87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.417025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c090ef-53a9-417c-9e63-a53fbbec87b2 admin admin] PATH_INFO: `/v3/projects/e6c65b6389f04a898b934d044814bed7/users/f1a3380d761243478f5a0f79f1fe7ede/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.436008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c090ef-53a9-417c-9e63-a53fbbec87b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c65b6389f04a898b934d044814bed7, user_id=f1a3380d761243478f5a0f79f1fe7ede, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:23.438791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c090ef-53a9-417c-9e63-a53fbbec87b2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.455767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1053/2104] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:23 2022] PUT /identity/v3/projects/e6c65b6389f04a898b934d044814bed7/users/f1a3380d761243478f5a0f79f1fe7ede/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:23.468010 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.468278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.468554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.472279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aab509-b2d0-4afd-b016-9b723b825c10 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.476361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:23.508121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] MFA Rules not processed for user `f1a3380d761243478f5a0f79f1fe7ede`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:23.509625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:23.540148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:23.541008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.541128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.541334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] PATH_INFO: `/v3/users/42ac78319fe54be289f4e973dcd0c6c6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.542541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ac78319fe54be289f4e973dcd0c6c6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:23.544494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.579239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:23.593137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1054/2105] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:23 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:23.597811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.601740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:23.605844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ac78319fe54be289f4e973dcd0c6c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.626398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ac78319fe54be289f4e973dcd0c6c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.627905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ac78319fe54be289f4e973dcd0c6c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.638213 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54828794-9a0b-446f-8d84-6a2edbe100c9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.649071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:23.649731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:23.650014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:23.650274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:23.650910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:23.652816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:23.662145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ac78319fe54be289f4e973dcd0c6c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.662936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ac78319fe54be289f4e973dcd0c6c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:23.688436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1052/2106] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:23 2022] DELETE /identity/v3/users/42ac78319fe54be289f4e973dcd0c6c6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:23.713484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1055/2107] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:23 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:23.715824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.717770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:23.894266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a23fc-96f4-4f98-9bbe-a550458b7e9d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:23.958911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:23.963034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:24.040795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.041498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.041843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.042579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.042794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.044922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.080343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1053/2108] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:23 2022] POST /identity/v3/users => generated 306 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:24.085910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:24.086960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd98d85-4d80-43dd-a3f8-62d238ae198b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:24.092614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.093703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.094135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.094509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.097409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:24.110290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9f8d7-44a9-4f34-94d4-9a5c6837f2b4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:24.118128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.118961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.119626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.120144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.121206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.124345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.136428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1054/2109] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:24.141838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:24.166306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b7d9a-2b67-4441-a2ab-3c2f8f62d098 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:24.172517 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.174356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.175055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.175055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] PATH_INFO: `/v3/projects/f6c4c168a9c44aa0bcf79d00cbe56482/users/07e75712dcf040ff9a8acf73ba34d8ae/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.197016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c4c168a9c44aa0bcf79d00cbe56482, user_id=07e75712dcf040ff9a8acf73ba34d8ae, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.203587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.207671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.209127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.224553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1056/2110] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:24.242982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:24.246543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:24.264333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1055/2111] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:24 2022] PUT /identity/v3/projects/f6c4c168a9c44aa0bcf79d00cbe56482/users/07e75712dcf040ff9a8acf73ba34d8ae/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:24.270230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:24.276141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dac67-ba7e-48ff-8470-da0c81d6173e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:24.299732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:24.302169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:24.355609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.356739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.357095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.357389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] PATH_INFO: `/v3/projects/69bc731de5f2454784904a8b49cecf50` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.359458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bc731de5f2454784904a8b49cecf50)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.364207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.443212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f626b-6f1a-4e8c-8790-9ee08590cefa admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:24.455243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.457404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.457404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.458804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.461490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.465479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.478931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bc731de5f2454784904a8b49cecf50', 'request_id': 'req-7963e039-9c17-40aa-90d8-635123387d18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:24.489699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bc731de5f2454784904a8b49cecf50', 'request_id': 'req-7963e039-9c17-40aa-90d8-635123387d18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:24.492903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1056/2112] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:24.495844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:24.509601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bc731de5f2454784904a8b49cecf50', 'request_id': 'req-7963e039-9c17-40aa-90d8-635123387d18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:24.521085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa348703-f56c-4a2b-863f-6530f20678d0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:24.527697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] The token cache is being invalidate because project 69bc731de5f2454784904a8b49cecf50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:24.527997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:24.528701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7963e039-9c17-40aa-90d8-635123387d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:24.537412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1057/2113] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:24 2022] DELETE /identity/v3/projects/69bc731de5f2454784904a8b49cecf50 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:24.542584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd951c4-ad16-44bc-94ae-a87c2459e3de None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.543107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd951c4-ad16-44bc-94ae-a87c2459e3de None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.543545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd951c4-ad16-44bc-94ae-a87c2459e3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.597792 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9cd951c4-ad16-44bc-94ae-a87c2459e3de None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:24.601278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9cd951c4-ad16-44bc-94ae-a87c2459e3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:24.686191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c604f9-98fd-484d-9b88-b879102f2c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.686981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c604f9-98fd-484d-9b88-b879102f2c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.687179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c604f9-98fd-484d-9b88-b879102f2c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.687423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c604f9-98fd-484d-9b88-b879102f2c35 admin admin] PATH_INFO: `/v3/projects/f6c4c168a9c44aa0bcf79d00cbe56482/users/07e75712dcf040ff9a8acf73ba34d8ae/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.695434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c604f9-98fd-484d-9b88-b879102f2c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c4c168a9c44aa0bcf79d00cbe56482, user_id=07e75712dcf040ff9a8acf73ba34d8ae, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.700561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c604f9-98fd-484d-9b88-b879102f2c35 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.736546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1057/2114] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:24 2022] PUT /identity/v3/projects/f6c4c168a9c44aa0bcf79d00cbe56482/users/07e75712dcf040ff9a8acf73ba34d8ae/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:24.748690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdadc5c-b0b2-46c7-a3af-6dbe306ed5b6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.749121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdadc5c-b0b2-46c7-a3af-6dbe306ed5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.750554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdadc5c-b0b2-46c7-a3af-6dbe306ed5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.791469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1058/2115] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:24.802493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97dca-5ca2-4fd1-882a-42b9fa8989e3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.803268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97dca-5ca2-4fd1-882a-42b9fa8989e3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.803268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97dca-5ca2-4fd1-882a-42b9fa8989e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.828423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-afdadc5c-b0b2-46c7-a3af-6dbe306ed5b6 None None] MFA Rules not processed for user `07e75712dcf040ff9a8acf73ba34d8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:24.829753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-afdadc5c-b0b2-46c7-a3af-6dbe306ed5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:24.831936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82c97dca-5ca2-4fd1-882a-42b9fa8989e3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:24.833282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82c97dca-5ca2-4fd1-882a-42b9fa8989e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:24.928734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:24.955285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1059/2116] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:24.956431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97dca-5ca2-4fd1-882a-42b9fa8989e3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:24.971444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97dca-5ca2-4fd1-882a-42b9fa8989e3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:24.977843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:24.978650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:24.979039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:24.979551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:24.980368 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:24.981128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:24.983228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:24.999144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1058/2117] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:25.001589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1060/2118] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:25.003157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdadc5c-b0b2-46c7-a3af-6dbe306ed5b6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.012405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.014537 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:25.029081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdadc5c-b0b2-46c7-a3af-6dbe306ed5b6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.040062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.040856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.041286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.041711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.042515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.046884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.100944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:25.119846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1059/2119] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:25 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:25.125135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.152363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7ed32-9d79-4a50-a4cf-bbb5ae3a5eb1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.223948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c659d-9bd7-4592-92e5-86e4eb242628 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.227302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.227943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.228976 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.229266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.230942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.231687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.231969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.232252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.232999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.236150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.278007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1060/2120] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:25 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:25.282262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.294572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6450d6a-a2e3-43d7-a76f-f14603197df3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.299536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.300141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.300427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.300755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.301345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.303131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.314417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.320228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.320369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1061/2121] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:25.321300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1061/2122] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:25.333119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ea50-dc24-44e2-8cc2-242dbdf03f51 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.340654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.341870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.342171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.342528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.343247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.344929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.357411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1062/2123] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:25.361897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.377828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56266f-26a6-49eb-b21f-d35e690782bf service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.382146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e3dc6-9cca-48d7-a47f-b5d1e3280104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.382867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e3dc6-9cca-48d7-a47f-b5d1e3280104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.383150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e3dc6-9cca-48d7-a47f-b5d1e3280104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.383422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e3dc6-9cca-48d7-a47f-b5d1e3280104 admin admin] PATH_INFO: `/v3/projects/885d68a52a0342d9b0ceccb498e8f8b3/users/cd3cb1adb46548f2b9e3d0cd79d5e8b0/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.401887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e3dc6-9cca-48d7-a47f-b5d1e3280104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=885d68a52a0342d9b0ceccb498e8f8b3, user_id=cd3cb1adb46548f2b9e3d0cd79d5e8b0, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.404758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e3dc6-9cca-48d7-a47f-b5d1e3280104 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.421695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1062/2124] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:25 2022] PUT /identity/v3/projects/885d68a52a0342d9b0ceccb498e8f8b3/users/cd3cb1adb46548f2b9e3d0cd79d5e8b0/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:25.426809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.432413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501bdc-e9a0-4d46-8fba-035e7b1def0f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.432703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501bdc-e9a0-4d46-8fba-035e7b1def0f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.433014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501bdc-e9a0-4d46-8fba-035e7b1def0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.442333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990813-4814-443d-b5fb-53cb4dc0c306 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.463794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c3501bdc-e9a0-4d46-8fba-035e7b1def0f None None] MFA Rules not processed for user `cd3cb1adb46548f2b9e3d0cd79d5e8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:25.465033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c3501bdc-e9a0-4d46-8fba-035e7b1def0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:25.473662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:25.506606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.507358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.507636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.507901 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.509823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:25.562221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1063/2125] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:25.563332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3501bdc-e9a0-4d46-8fba-035e7b1def0f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.577860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.579343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.590640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1063/2126] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:25 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:25.685084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3501bdc-e9a0-4d46-8fba-035e7b1def0f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.695425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.696811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.698567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.698867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.699728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.702285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.773039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1064/2127] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:25 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:25.774096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.794313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795d84-abf7-484f-abd6-8b1eb62871e5 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.830443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:25.884946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.885681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.885954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.886342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.887041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.889538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.930565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1064/2128] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:25 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:25.933570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:25.948552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21eeb-8fb9-4b62-be28-f10b18dedb85 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:25.962765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:25.963941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:25.965509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:25.966998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:25.968052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:25.973547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:25.991933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1065/2129] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:25.996902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:26.018185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039197c4-34ce-4544-b4e0-8fba1a1b1252 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:26.053125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:26.055671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:26.056996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:26.057316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] PATH_INFO: `/v3/projects/1249bac4081542cfb64d6e644e65e524/users/b5c6fdcf2aa343fba316f73c08795e92/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:26.101680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1249bac4081542cfb64d6e644e65e524, user_id=b5c6fdcf2aa343fba316f73c08795e92, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:26.108676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:26.169925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1065/2130] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:25 2022] PUT /identity/v3/projects/1249bac4081542cfb64d6e644e65e524/users/b5c6fdcf2aa343fba316f73c08795e92/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:26.171190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:26.189679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1a74-8ff1-4d75-9f1c-cfbf77163ddc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:26.351571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb6f1-839e-4325-adaf-860676e81e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:26.352259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb6f1-839e-4325-adaf-860676e81e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:26.352551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb6f1-839e-4325-adaf-860676e81e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:26.353092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb6f1-839e-4325-adaf-860676e81e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:26.353945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb6f1-839e-4325-adaf-860676e81e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:26.356143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb6f1-839e-4325-adaf-860676e81e77 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:26.379288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1066/2131] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:26.385222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:26.403732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102784e-c4d7-4838-8bee-54047d1613e2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:26.410357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:26.411102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:26.411388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:26.412362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] PATH_INFO: `/v3/projects/1249bac4081542cfb64d6e644e65e524/users/b5c6fdcf2aa343fba316f73c08795e92/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:26.415335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1249bac4081542cfb64d6e644e65e524, user_id=b5c6fdcf2aa343fba316f73c08795e92, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:26.419681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:26.440211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1066/2132] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:26 2022] PUT /identity/v3/projects/1249bac4081542cfb64d6e644e65e524/users/b5c6fdcf2aa343fba316f73c08795e92/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:26.452519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1462b-db9b-48c3-9b49-a686ea5083ef None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:26.452519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1462b-db9b-48c3-9b49-a686ea5083ef None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:26.452519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1462b-db9b-48c3-9b49-a686ea5083ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:26.514821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-88d1462b-db9b-48c3-9b49-a686ea5083ef None None] MFA Rules not processed for user `b5c6fdcf2aa343fba316f73c08795e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:26.516133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-88d1462b-db9b-48c3-9b49-a686ea5083ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:26.532356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:26.652705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1067/2133] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:26.664511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:26.667499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:26.756973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23bda-592e-4171-bda4-ba3d96c658dd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:26.762045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:26.763071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:26.763411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:26.763728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:26.870241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b518b-46ef-4ac7-a114-854e850595bc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:26.870845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b518b-46ef-4ac7-a114-854e850595bc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:26.871149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b518b-46ef-4ac7-a114-854e850595bc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:26.872515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1068/2134] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:34:26.875068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:26.876734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:26.890107 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1067/2135] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:26.919776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:26.920167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:26.921124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:26.948797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:26.951355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:26.969999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:26.971466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:27.013810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:27.042439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1069/2136] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:34:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:27.054417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.057294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:27.057550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d85385-7f11-4eee-bf89-16469c104710 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.063965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.064619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.064899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.065174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] PATH_INFO: `/v3/users/d2194dacd30e45bd87d38b70d1b3bbdc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.066380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2194dacd30e45bd87d38b70d1b3bbdc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.068862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.075947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b169-d7c8-436f-9ab8-dd41b32cfc30 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.081950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.083067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.083067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.083067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.092351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.094116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.106472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1070/2137] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:27.139494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2194dacd30e45bd87d38b70d1b3bbdc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.150353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2194dacd30e45bd87d38b70d1b3bbdc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.151137 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2194dacd30e45bd87d38b70d1b3bbdc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.172885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2194dacd30e45bd87d38b70d1b3bbdc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.174203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5892946d-566b-4f4a-b08a-c6e41fa6f139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2194dacd30e45bd87d38b70d1b3bbdc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.193424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1068/2138] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:26 2022] DELETE /identity/v3/users/d2194dacd30e45bd87d38b70d1b3bbdc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:27.475694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.488370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aeb784-fd3f-4e7b-8102-a72dbe3c1e46 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.619738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.621142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.621702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.622115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] PATH_INFO: `/v3/projects/ac6df5008fc145cd8a3cf67e1154ca8a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.623612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6df5008fc145cd8a3cf67e1154ca8a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.625754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.681981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:27.703308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6df5008fc145cd8a3cf67e1154ca8a', 'request_id': 'req-482fb826-4077-4744-9253-b8785b88021d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.713762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6df5008fc145cd8a3cf67e1154ca8a', 'request_id': 'req-482fb826-4077-4744-9253-b8785b88021d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.728903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6df5008fc145cd8a3cf67e1154ca8a', 'request_id': 'req-482fb826-4077-4744-9253-b8785b88021d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.746666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] The token cache is being invalidate because project ac6df5008fc145cd8a3cf67e1154ca8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:27.747278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.748634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-482fb826-4077-4744-9253-b8785b88021d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:27.750810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1071/2139] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:27 2022] DELETE /identity/v3/projects/ac6df5008fc145cd8a3cf67e1154ca8a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:27.758278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2f2a-440b-4ad6-a285-c4702af96c8d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.758784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2f2a-440b-4ad6-a285-c4702af96c8d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.759019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2f2a-440b-4ad6-a285-c4702af96c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.785934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f3ba2f2a-440b-4ad6-a285-c4702af96c8d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:27.787189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f3ba2f2a-440b-4ad6-a285-c4702af96c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:27.857264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1069/2140] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:27.867391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81a38-a333-44ea-9153-92f9aae7ff7b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.867672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81a38-a333-44ea-9153-92f9aae7ff7b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.867943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81a38-a333-44ea-9153-92f9aae7ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.888563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cdf81a38-a333-44ea-9153-92f9aae7ff7b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:27.889794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cdf81a38-a333-44ea-9153-92f9aae7ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:27.898426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1072/2141] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:27.902626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2f2a-440b-4ad6-a285-c4702af96c8d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.914147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2f2a-440b-4ad6-a285-c4702af96c8d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.921507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.922169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.924254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.924770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.925492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:27.925857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.928022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.947732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1070/2142] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:27.952385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf81a38-a333-44ea-9153-92f9aae7ff7b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.962769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf81a38-a333-44ea-9153-92f9aae7ff7b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.967487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.968114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.968390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.968657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.969284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.971210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.006638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1073/2143] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:27 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:28.010892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:28.021694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75331d3-1925-473b-9be5-160411e9cf14 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.058893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:28.092914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.093604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.093887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.094154 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.094784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.096730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.121412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1071/2144] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:28 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:28.125555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:28.137018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da9ebe-a7b9-486e-8a25-b9735ca994e6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.141897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.142503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.142778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.143047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.143694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.145285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.156197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1074/2145] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:28.160566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:28.172118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180582-b32c-4ad9-9c60-58f43292c81d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.177027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ac7c3-576b-4753-9b27-df00e0e9bb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.177745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ac7c3-576b-4753-9b27-df00e0e9bb1d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.178174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ac7c3-576b-4753-9b27-df00e0e9bb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.178452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ac7c3-576b-4753-9b27-df00e0e9bb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.179179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ac7c3-576b-4753-9b27-df00e0e9bb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.180790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ac7c3-576b-4753-9b27-df00e0e9bb1d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.191620 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1072/2146] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:28.197250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:28.207671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c0ccf-a909-414a-864a-00ff7c7b7f0a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.212599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.213233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.213592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.213864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] PATH_INFO: `/v3/projects/afe8c5f3d0b744c1995c3f2bec122097/users/4da2d83be930445aa7ffba8e3a0116f8/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.229234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe8c5f3d0b744c1995c3f2bec122097, user_id=4da2d83be930445aa7ffba8e3a0116f8, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.231906 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.246909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1075/2147] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:28 2022] PUT /identity/v3/projects/afe8c5f3d0b744c1995c3f2bec122097/users/4da2d83be930445aa7ffba8e3a0116f8/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:28.253541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.254005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.254503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.275500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:28.276692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:28.347618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1073/2148] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:28.355329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:28.357999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:28.362904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:28.364317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:28.419644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267323d8-ab5a-4a2f-8c44-54a767bae22a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.423467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.424093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.424395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.424659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.426416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64275b-60a1-4638-9b37-875da242fb10 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.430210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.430846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.431122 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.431393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.433101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:28.434254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.435669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.445281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1076/2149] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:28.500012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.501502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.511308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1074/2150] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:30.277640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:30.284033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:30.329654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baf78b-627c-4c25-bbab-1251247de848 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:30.349555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:30.350576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:30.351093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:30.351547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] PATH_INFO: `/v3/users/f2335c7f879a420bb2380a1f22b3cbd6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:30.354015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2335c7f879a420bb2380a1f22b3cbd6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:30.357563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:30.481448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:30.483549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:30.496198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:30.502929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8df8c3-5d25-4203-8f28-b175e13d97e4 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:30.504694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2335c7f879a420bb2380a1f22b3cbd6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.511451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:30.515923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:30.516663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:30.516908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:30.517184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] PATH_INFO: `/v3/users/f1a3380d761243478f5a0f79f1fe7ede` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:30.518366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a3380d761243478f5a0f79f1fe7ede)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:30.520653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:30.524163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2335c7f879a420bb2380a1f22b3cbd6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.548513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2335c7f879a420bb2380a1f22b3cbd6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.551660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2335c7f879a420bb2380a1f22b3cbd6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.553234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73aabdd7-8ae4-462c-8444-b5595e35def8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2335c7f879a420bb2380a1f22b3cbd6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.582840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1077/2151] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:30 2022] DELETE /identity/v3/users/f2335c7f879a420bb2380a1f22b3cbd6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:30.587722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:30.588119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:30.588572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:30.616812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:30.618071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:30.624527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a3380d761243478f5a0f79f1fe7ede'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.636979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a3380d761243478f5a0f79f1fe7ede'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.637946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a3380d761243478f5a0f79f1fe7ede'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.658740 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a3380d761243478f5a0f79f1fe7ede'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.659479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-412ff4c0-cea7-4cb6-9765-8b0690490c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a3380d761243478f5a0f79f1fe7ede'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:30.682169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1075/2152] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:30 2022] DELETE /identity/v3/users/f1a3380d761243478f5a0f79f1fe7ede => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:30.687079 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:30.687370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:30.687651 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:30.717193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:30.720617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:30.840310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1076/2153] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:30.843895 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1078/2154] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:30.851288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:30.854687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:30.859547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:30.861687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:30.972415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52570982-cd4b-44c4-9388-1b47a9e47ac0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:30.996662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1e787-c6a0-4292-b434-97a78d72a216 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:31.010090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:31.012278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:31.015088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:31.015472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:31.042976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:31.047541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:31.089791 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:31.090741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:31.091018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1077/2155] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:31.091421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:31.091912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:31.104417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:31.106224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:31.121714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1079/2156] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:31.773836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:31.775470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:31.795755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc75fa-9d77-4c91-96f9-60c04e578afa service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:31.800785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:31.801757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:31.802104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:31.802446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] PATH_INFO: `/v3/projects/e6c65b6389f04a898b934d044814bed7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:31.804013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c65b6389f04a898b934d044814bed7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:31.806175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:31.832416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:31.894775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c65b6389f04a898b934d044814bed7', 'request_id': 'req-134b76cf-3054-4032-840e-1b8edb551582'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:31.904791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c65b6389f04a898b934d044814bed7', 'request_id': 'req-134b76cf-3054-4032-840e-1b8edb551582'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:31.920743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c65b6389f04a898b934d044814bed7', 'request_id': 'req-134b76cf-3054-4032-840e-1b8edb551582'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:31.937224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] The token cache is being invalidate because project e6c65b6389f04a898b934d044814bed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:31.937959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:31.938913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:31.943360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1078/2157] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:31 2022] DELETE /identity/v3/projects/e6c65b6389f04a898b934d044814bed7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:31.947973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:31.977163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20cf8-62ec-4985-b50c-e98d48c22f51 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:32.004055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:32.007084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:32.036205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:32.105091 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:32.106465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:32.108048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:32.108048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] PATH_INFO: `/v3/users/07e75712dcf040ff9a8acf73ba34d8ae` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:32.111953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e75712dcf040ff9a8acf73ba34d8ae)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:32.122747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:32.174819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b76cf-3054-4032-840e-1b8edb551582 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:32.183279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:32.184527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:32.184817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:32.185231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] PATH_INFO: `/v3/projects/f9d9cc0801284c8baeedd624e742e058` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:32.186983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d9cc0801284c8baeedd624e742e058)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:32.189570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:32.271117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e75712dcf040ff9a8acf73ba34d8ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.295410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e75712dcf040ff9a8acf73ba34d8ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.312818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d9cc0801284c8baeedd624e742e058', 'request_id': 'req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.321970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d9cc0801284c8baeedd624e742e058', 'request_id': 'req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.330015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e75712dcf040ff9a8acf73ba34d8ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.331323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e75712dcf040ff9a8acf73ba34d8ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.332204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e75712dcf040ff9a8acf73ba34d8ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.339954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d9cc0801284c8baeedd624e742e058', 'request_id': 'req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.367354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1080/2158] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:31 2022] DELETE /identity/v3/users/07e75712dcf040ff9a8acf73ba34d8ae => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:32.372270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] The token cache is being invalidate because project f9d9cc0801284c8baeedd624e742e058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:32.372677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.373412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.377827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1079/2159] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:32 2022] DELETE /identity/v3/projects/f9d9cc0801284c8baeedd624e742e058 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:32.379605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:32.381400 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:32.475579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666f67-8744-494c-8766-8642d332c27b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:32.495574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:32.497798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:32.498674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:32.500464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] PATH_INFO: `/v3/users/1be37ffbc1b7425b9f405c64aa0da9ff` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:32.503433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be37ffbc1b7425b9f405c64aa0da9ff)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:32.507847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:32.615138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be37ffbc1b7425b9f405c64aa0da9ff'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.620244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:32.634470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be37ffbc1b7425b9f405c64aa0da9ff'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.657955 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be37ffbc1b7425b9f405c64aa0da9ff'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.659147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be37ffbc1b7425b9f405c64aa0da9ff'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.659815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be37ffbc1b7425b9f405c64aa0da9ff'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:32.681006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1081/2160] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:32 2022] DELETE /identity/v3/users/1be37ffbc1b7425b9f405c64aa0da9ff => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:32.844902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:32.847093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:32.890776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:32.910568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:32.911603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:32.952055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53ccc-fac0-4b0c-944f-54c95d70d3bb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:33.026955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:33.028743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.029037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.029316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] PATH_INFO: `/v3/users/cd3cb1adb46548f2b9e3d0cd79d5e8b0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.030739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3cb1adb46548f2b9e3d0cd79d5e8b0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:33.032927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:33.072210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d297793-0ff3-484b-bfd9-a1acace2a744 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:33.084328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:33.086060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.086060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.086293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] PATH_INFO: `/v3/projects/f6c4c168a9c44aa0bcf79d00cbe56482` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.088309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c4c168a9c44aa0bcf79d00cbe56482)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:33.091008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:33.129529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3cb1adb46548f2b9e3d0cd79d5e8b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.150296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3cb1adb46548f2b9e3d0cd79d5e8b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.150296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3cb1adb46548f2b9e3d0cd79d5e8b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.180622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3cb1adb46548f2b9e3d0cd79d5e8b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.182234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe7df948-eace-40f1-89ce-b89b4339aaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3cb1adb46548f2b9e3d0cd79d5e8b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.190001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c4c168a9c44aa0bcf79d00cbe56482', 'request_id': 'req-aa9fee99-22bf-4c46-8add-212eb085f4a1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.211135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1080/2161] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:32 2022] DELETE /identity/v3/users/cd3cb1adb46548f2b9e3d0cd79d5e8b0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:33.214478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c4c168a9c44aa0bcf79d00cbe56482', 'request_id': 'req-aa9fee99-22bf-4c46-8add-212eb085f4a1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.215526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d64a9-56f6-4b44-827f-f4ef36d8e26e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.215810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d64a9-56f6-4b44-827f-f4ef36d8e26e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.216563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d64a9-56f6-4b44-827f-f4ef36d8e26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.232309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c4c168a9c44aa0bcf79d00cbe56482', 'request_id': 'req-aa9fee99-22bf-4c46-8add-212eb085f4a1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.262666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] The token cache is being invalidate because project f6c4c168a9c44aa0bcf79d00cbe56482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:33.263193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.264394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa9fee99-22bf-4c46-8add-212eb085f4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.267664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a20d64a9-56f6-4b44-827f-f4ef36d8e26e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:33.269212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a20d64a9-56f6-4b44-827f-f4ef36d8e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.270620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1082/2162] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:32 2022] DELETE /identity/v3/projects/f6c4c168a9c44aa0bcf79d00cbe56482 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:33.276073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.278062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.278802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.309349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:33.311547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.427658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:33.442881 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:33.465490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1083/2163] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:33.466997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:33.468979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.483910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1081/2164] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:33.485787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.486339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.501930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.505393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15569bf5-8519-4af3-8d8a-97b8ba0c56fd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:33.521524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:33.524061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.531354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:33.531354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.531354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.531354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] PATH_INFO: `/v3/projects/e57a84ba8ffe4fd499f82aaf56e5abed` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.533155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1082/2165] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:33.534073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57a84ba8ffe4fd499f82aaf56e5abed)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:33.536920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:33.537962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:33.539454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.640864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdbd05-de18-487f-957a-805c6668b796 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:33.655066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57a84ba8ffe4fd499f82aaf56e5abed', 'request_id': 'req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.669665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57a84ba8ffe4fd499f82aaf56e5abed', 'request_id': 'req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.700873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57a84ba8ffe4fd499f82aaf56e5abed', 'request_id': 'req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.714578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] The token cache is being invalidate because project e57a84ba8ffe4fd499f82aaf56e5abed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:33.714994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.715799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:33.717484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1084/2166] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:33 2022] DELETE /identity/v3/projects/e57a84ba8ffe4fd499f82aaf56e5abed => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:33.718503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:33.720082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.724252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:33.727914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.728455 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.728924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.732715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.844803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ba85-9e35-4afc-b80a-15981dc0bcde admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:33.851194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bc2bd-9203-4329-a035-6fd4e99969fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:33.852659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bc2bd-9203-4329-a035-6fd4e99969fd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.853111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bc2bd-9203-4329-a035-6fd4e99969fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.853623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bc2bd-9203-4329-a035-6fd4e99969fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.854724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bc2bd-9203-4329-a035-6fd4e99969fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:33.855196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bc2bd-9203-4329-a035-6fd4e99969fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:33.855978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:33.857953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bc2bd-9203-4329-a035-6fd4e99969fd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:33.858699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:33.883224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1085/2167] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:33.884618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b94f5-6837-4622-ad98-f4c779045b3f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.884979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1083/2168] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:33.885245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b94f5-6837-4622-ad98-f4c779045b3f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.885556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b94f5-6837-4622-ad98-f4c779045b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.888952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:33.904288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e69e-a4b2-4e16-af4f-e6dff35040d6 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:33.918709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:33.919343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.919622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.919892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.920691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:33.925930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:33.930413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ce0b94f5-6837-4622-ad98-f4c779045b3f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:33.932349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ce0b94f5-6837-4622-ad98-f4c779045b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.951406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1086/2169] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:33.962344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22f04-b10c-40c9-8a1e-f2e5ee5f31fc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.962789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22f04-b10c-40c9-8a1e-f2e5ee5f31fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.963113 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22f04-b10c-40c9-8a1e-f2e5ee5f31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.993399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1084/2170] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:33.997741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.006345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2bb22f04-b10c-40c9-8a1e-f2e5ee5f31fc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:34.007868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2bb22f04-b10c-40c9-8a1e-f2e5ee5f31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:34.077436 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:34.115391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48872687-82ca-4eb1-a2ae-966936a5c953 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.135881 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.137845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.138330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.138773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.139713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.142907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.159696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1087/2171] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:34.165359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb22f04-b10c-40c9-8a1e-f2e5ee5f31fc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.188637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1085/2172] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:34.190392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.192139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb22f04-b10c-40c9-8a1e-f2e5ee5f31fc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.206619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.210412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.210653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.211334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.212028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:34.212028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.213806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.214598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b9136-8dfd-47d6-ab26-5b64a33f5c0c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.224682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.225977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.226326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:34.227650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.227650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.228827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.232091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.250973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1088/2173] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:34.255489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.262188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1086/2174] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:34.263316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.267205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe7f4-2d08-4411-9a46-73b12e6f6e8f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.272380 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.273007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.273289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.273703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.274346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.276638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.285329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce59304-7a55-45d0-81ed-15b90036a0e8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.291226 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.292442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.292904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.293421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.294298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.296520 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.333901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1089/2175] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:34 2022] POST /identity/v3/projects => generated 359 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:34.339285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1087/2176] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:34.339482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.342898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.362999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9b46-74ee-41ff-95da-00bd5330ff22 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.510309 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3232e28-7915-4b62-92b9-0bea0bbd0a10 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.519076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.519471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.519822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.520160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.520821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.527340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.528694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.530490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.530937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.544273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] PATH_INFO: `/v3/projects/7e0fa6b0d03c42768052e2e15b5804af/users/279a3863ce324e599ce0b9fb1c49d4b8/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.585776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1090/2177] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:34 2022] POST /identity/v3/users => generated 280 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:34.586921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.588805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:34.594913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0fa6b0d03c42768052e2e15b5804af, user_id=279a3863ce324e599ce0b9fb1c49d4b8, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.598080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.603347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e02f-b32b-42dd-ba11-8f047339f8c8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.614149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:34.620656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.620656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.620656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] PATH_INFO: `/v3/projects/885d68a52a0342d9b0ceccb498e8f8b3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.624519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=885d68a52a0342d9b0ceccb498e8f8b3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.627210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.646071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1088/2178] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:34 2022] PUT /identity/v3/projects/7e0fa6b0d03c42768052e2e15b5804af/users/279a3863ce324e599ce0b9fb1c49d4b8/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:34.656738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:34.794105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885d68a52a0342d9b0ceccb498e8f8b3', 'request_id': 'req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:34.813197 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885d68a52a0342d9b0ceccb498e8f8b3', 'request_id': 'req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:34.836979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885d68a52a0342d9b0ceccb498e8f8b3', 'request_id': 'req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:34.840728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744144e-85c8-4cd6-897b-cc8cbde593e9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:34.850942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] The token cache is being invalidate because project 885d68a52a0342d9b0ceccb498e8f8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:34.851375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:34.852176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b7abd2cd-7db8-48dd-83d0-1d0eee07ba6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:34.854136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1091/2179] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:34 2022] DELETE /identity/v3/projects/885d68a52a0342d9b0ceccb498e8f8b3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:34.855913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:34.856290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:34.857714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.938377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] MFA Rules not processed for user `279a3863ce324e599ce0b9fb1c49d4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:34.942951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:34.955607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:35.000546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:35.013068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.014190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.014806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.015530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.016405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.019020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:35.032253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1089/2180] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:35.049237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1092/2181] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:35.049237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.049237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.050927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.055439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.072329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8aff-3443-4646-abf6-85113204a9fa admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.074538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42c8c-2c81-4c32-8ebd-f8f4afc3d7a6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.078367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.079377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.079785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.080104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.080442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.080725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.081001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] PATH_INFO: `/v3/users/0c30b16e0dd14a66867b794c3af424a5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.081179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] PATH_INFO: `/v3/users/b5c6fdcf2aa343fba316f73c08795e92` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.082311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c30b16e0dd14a66867b794c3af424a5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.082920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c6fdcf2aa343fba316f73c08795e92)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.085289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:35.085612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:35.182796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c30b16e0dd14a66867b794c3af424a5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.188719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c6fdcf2aa343fba316f73c08795e92'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.198405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c30b16e0dd14a66867b794c3af424a5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.203855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c6fdcf2aa343fba316f73c08795e92'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.205353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c6fdcf2aa343fba316f73c08795e92'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.220433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c30b16e0dd14a66867b794c3af424a5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.222266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c30b16e0dd14a66867b794c3af424a5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.222704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c6fdcf2aa343fba316f73c08795e92'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.223411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c30b16e0dd14a66867b794c3af424a5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.223775 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c6fdcf2aa343fba316f73c08795e92'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:35.244580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1090/2182] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:35 2022] DELETE /identity/v3/users/b5c6fdcf2aa343fba316f73c08795e92 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:35.245894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.254932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.257947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1093/2183] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:35 2022] DELETE /identity/v3/users/0c30b16e0dd14a66867b794c3af424a5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:35.259726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.264401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.353464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328896-3194-4d7c-9654-60cb75ea3922 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.363921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413c50-3a4b-4f16-94b6-44044a8c9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.364643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413c50-3a4b-4f16-94b6-44044a8c9bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.364929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413c50-3a4b-4f16-94b6-44044a8c9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.366040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413c50-3a4b-4f16-94b6-44044a8c9bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.366143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71413c50-3a4b-4f16-94b6-44044a8c9bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.368393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71413c50-3a4b-4f16-94b6-44044a8c9bd7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:35.393632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016160-ce5a-495c-9c24-795b852e2f75 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.400819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b97cc-b89a-4f25-85e4-4b4167eb4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.401604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b97cc-b89a-4f25-85e4-4b4167eb4ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.401886 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b97cc-b89a-4f25-85e4-4b4167eb4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.402160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b97cc-b89a-4f25-85e4-4b4167eb4ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.402830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b97cc-b89a-4f25-85e4-4b4167eb4ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.403840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1094/2184] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:35 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:35.405089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.405570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.405920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.408137 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b97cc-b89a-4f25-85e4-4b4167eb4ab1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:35.424414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1091/2185] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:35.424414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f584ef3-b985-4f52-80eb-dad0d749d4a0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.424414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f584ef3-b985-4f52-80eb-dad0d749d4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.424414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f584ef3-b985-4f52-80eb-dad0d749d4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.442305 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] MFA Rules not processed for user `4da2d83be930445aa7ffba8e3a0116f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:35.443648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.448880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0f584ef3-b985-4f52-80eb-dad0d749d4a0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:35.451374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0f584ef3-b985-4f52-80eb-dad0d749d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.470116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:35.519899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:35.542888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1095/2186] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:35.544725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.547135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.558942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1092/2187] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:35.560166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f584ef3-b985-4f52-80eb-dad0d749d4a0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.570061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda7d4e-a86a-46ff-9b09-608156179a76 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.575661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.576383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f584ef3-b985-4f52-80eb-dad0d749d4a0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.576533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.576881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.577130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.577799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.579775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:35.581304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.582228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.582446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.582864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] PATH_INFO: `/v3/projects/acb2a529552b40bab1a3f625253473ce/users/ef945c7276ba4d33a05b05608b7dd4a8/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.604068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1096/2188] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:35 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:35.607884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.609531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.612937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb2a529552b40bab1a3f625253473ce, user_id=ef945c7276ba4d33a05b05608b7dd4a8, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.619698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:35.665478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1093/2189] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:35 2022] PUT /identity/v3/projects/acb2a529552b40bab1a3f625253473ce/users/ef945c7276ba4d33a05b05608b7dd4a8/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:35.665478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:35.676946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:35.742450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb79838-213b-471f-93de-02035a923ac4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.868038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7825de3-e0fe-4366-910b-dfa45ef2d84e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:35.875470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.876630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.877133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.877545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.877778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4fc29-8e19-4bfc-a9de-ff52ce5f3dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:35.878417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4fc29-8e19-4bfc-a9de-ff52ce5f3dd9 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:35.878930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4fc29-8e19-4bfc-a9de-ff52ce5f3dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:35.879055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4fc29-8e19-4bfc-a9de-ff52ce5f3dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:35.958031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:35.976644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:35.979216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.009589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1094/2190] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:36.010612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.011924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4fc29-8e19-4bfc-a9de-ff52ce5f3dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.013802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4fc29-8e19-4bfc-a9de-ff52ce5f3dd9 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.026925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84d08-7b50-44fd-b3e2-266e1d93a065 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:36.027569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1097/2191] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:36.029082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aed68-f6f0-4e9c-9ab6-1a14dc03f50e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.029780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aed68-f6f0-4e9c-9ab6-1a14dc03f50e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.030076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aed68-f6f0-4e9c-9ab6-1a14dc03f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.032482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:36.033217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.033977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.034217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.035017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.036701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.050583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1095/2192] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:36.051423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.054070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.062527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-271aed68-f6f0-4e9c-9ab6-1a14dc03f50e None None] MFA Rules not processed for user `ef945c7276ba4d33a05b05608b7dd4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:36.065007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-271aed68-f6f0-4e9c-9ab6-1a14dc03f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.078466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba1e91-2311-4a5a-acdd-e7f6ac8ed3e7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:36.095994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:36.104603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.105045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.105333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] PATH_INFO: `/v3/projects/1249bac4081542cfb64d6e644e65e524` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.107444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1249bac4081542cfb64d6e644e65e524)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.109944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.168085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1098/2193] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:36.172717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aed68-f6f0-4e9c-9ab6-1a14dc03f50e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.187444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aed68-f6f0-4e9c-9ab6-1a14dc03f50e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:36.221637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1249bac4081542cfb64d6e644e65e524', 'request_id': 'req-1358d4fc-03fc-4e80-84c2-e246dbecff7b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.223670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:36.242980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1249bac4081542cfb64d6e644e65e524', 'request_id': 'req-1358d4fc-03fc-4e80-84c2-e246dbecff7b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.259068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1249bac4081542cfb64d6e644e65e524', 'request_id': 'req-1358d4fc-03fc-4e80-84c2-e246dbecff7b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.276335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] The token cache is being invalidate because project 1249bac4081542cfb64d6e644e65e524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:36.276884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.279289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.281247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1096/2194] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:36 2022] DELETE /identity/v3/projects/1249bac4081542cfb64d6e644e65e524 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:36.284216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.286343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.308232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b91d91-8a9b-4169-a7d8-6b40c0799a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:36.308863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b91d91-8a9b-4169-a7d8-6b40c0799a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.309142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b91d91-8a9b-4169-a7d8-6b40c0799a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.309493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b91d91-8a9b-4169-a7d8-6b40c0799a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.310155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b91d91-8a9b-4169-a7d8-6b40c0799a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.311780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b91d91-8a9b-4169-a7d8-6b40c0799a20 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.327937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1099/2195] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:36.329161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.329488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.329760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.371929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:36.373686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.384417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1100/2196] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:36.385911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.387647 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.409737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d4fc-03fc-4e80-84c2-e246dbecff7b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:36.410681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927c99d-1e6a-4235-a41d-369f7a2a4be7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:36.418242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092855-bdbf-4a08-9a5a-398425b3bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:36.419576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092855-bdbf-4a08-9a5a-398425b3bd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.419946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092855-bdbf-4a08-9a5a-398425b3bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.420428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092855-bdbf-4a08-9a5a-398425b3bd54 admin admin] PATH_INFO: `/v3/projects/663ce7ec26bc44448f712d631f788894/users/b56acc789a014988806b9b72f43b8bd7/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.420799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:36.421516 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.421796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.422618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.429911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.459236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092855-bdbf-4a08-9a5a-398425b3bd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663ce7ec26bc44448f712d631f788894, user_id=b56acc789a014988806b9b72f43b8bd7, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.462749 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092855-bdbf-4a08-9a5a-398425b3bd54 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.493700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1101/2197] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:36 2022] PUT /identity/v3/projects/663ce7ec26bc44448f712d631f788894/users/b56acc789a014988806b9b72f43b8bd7/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:36.494875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff16b0-8721-4eb5-922f-12578d17d6a5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.495156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff16b0-8721-4eb5-922f-12578d17d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.496812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff16b0-8721-4eb5-922f-12578d17d6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.535186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-27ff16b0-8721-4eb5-922f-12578d17d6a5 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:36.536784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-27ff16b0-8721-4eb5-922f-12578d17d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.539940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.542554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.567153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1097/2198] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:36.568600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.571627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.578527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:36.601948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e139f-190a-4f84-b84e-d3b538ffcbef service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:36.629728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1102/2199] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:36.631315 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.631776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.632149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.664661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] MFA Rules not processed for user `b56acc789a014988806b9b72f43b8bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:36.666055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.685317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:36.686371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.686844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.687178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] PATH_INFO: `/v3/projects/e4e3ca01432b46a0a97329d52b5f9434` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.688545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e3ca01432b46a0a97329d52b5f9434)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.690986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:36.741799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:36.758463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e3ca01432b46a0a97329d52b5f9434', 'request_id': 'req-bb224f00-6904-4375-b916-5b424ecf1e77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.766395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e3ca01432b46a0a97329d52b5f9434', 'request_id': 'req-bb224f00-6904-4375-b916-5b424ecf1e77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.783217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e3ca01432b46a0a97329d52b5f9434', 'request_id': 'req-bb224f00-6904-4375-b916-5b424ecf1e77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.790161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1103/2200] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:36.790161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.794399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.807496 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] The token cache is being invalidate because project e4e3ca01432b46a0a97329d52b5f9434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:36.817758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.818916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:36.823595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52419f9-52b8-40c6-8dda-06bf68f1ec98 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:36.840384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1098/2201] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:36 2022] DELETE /identity/v3/projects/e4e3ca01432b46a0a97329d52b5f9434 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:36.841915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:36.845139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.983031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:36.984846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.985866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.986356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] PATH_INFO: `/v3/users/ef945c7276ba4d33a05b05608b7dd4a8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.989075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef945c7276ba4d33a05b05608b7dd4a8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:36.994490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.003865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224f00-6904-4375-b916-5b424ecf1e77 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.034518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.037284 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.037623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.039222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.045193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:37.047446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.052374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.088569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef945c7276ba4d33a05b05608b7dd4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:37.101826 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef945c7276ba4d33a05b05608b7dd4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:37.102054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1099/2202] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:37.104043 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.109403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:37.115727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:37.120237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef945c7276ba4d33a05b05608b7dd4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:37.121430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef945c7276ba4d33a05b05608b7dd4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:37.122639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90c192fb-c30f-414e-a865-eadf1df2d4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef945c7276ba4d33a05b05608b7dd4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:37.139013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1104/2203] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:36 2022] DELETE /identity/v3/users/ef945c7276ba4d33a05b05608b7dd4a8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:37.141779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.142285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.142765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.144603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1374e-44a1-40e5-8058-4498219f38fa admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.169758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:37.171657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:37.279471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1105/2204] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:37.280416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.281774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:37.289705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea25cb-b62f-4421-884e-80d5894fdd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.291185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea25cb-b62f-4421-884e-80d5894fdd86 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.291714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea25cb-b62f-4421-884e-80d5894fdd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.292148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea25cb-b62f-4421-884e-80d5894fdd86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.292785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea25cb-b62f-4421-884e-80d5894fdd86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.294914 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea25cb-b62f-4421-884e-80d5894fdd86 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.297137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd03ec-3b1b-4727-84b8-c08118ae0f52 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.302570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537b90f-e665-48dc-9c52-4a19ef278b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.303524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537b90f-e665-48dc-9c52-4a19ef278b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.304371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537b90f-e665-48dc-9c52-4a19ef278b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.304958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537b90f-e665-48dc-9c52-4a19ef278b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.305864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537b90f-e665-48dc-9c52-4a19ef278b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.308047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537b90f-e665-48dc-9c52-4a19ef278b36 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.347130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1100/2205] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:37.347130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.347130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.347130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.356190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1106/2206] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/projects => generated 409 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:37.359376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476bda7-98ae-4876-8cad-280c3dd40847 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.359376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476bda7-98ae-4876-8cad-280c3dd40847 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.359376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476bda7-98ae-4876-8cad-280c3dd40847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.375380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:37.377457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:37.402187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b476bda7-98ae-4876-8cad-280c3dd40847 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:37.404096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b476bda7-98ae-4876-8cad-280c3dd40847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:37.428471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:37.472280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1101/2207] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:37.476052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.480408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:37.494685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d3b9-b0c7-4c48-8e9b-bbe4d4d2eeef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.500843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.501807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.509331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1107/2208] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:37.512556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.512556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.512556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.513929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476bda7-98ae-4876-8cad-280c3dd40847 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.515704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.529140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476bda7-98ae-4876-8cad-280c3dd40847 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.537258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.538106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.538547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.538797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.542158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.544590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.550150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1102/2209] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/users => generated 295 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:37.551189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.554525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:37.595659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1108/2210] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/users => generated 305 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:37.597695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.614471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdeab0-9f3e-4262-aabd-7d780b0011b5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.641027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.641689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.641954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.643053 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.643474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:37.646371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.648135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.663393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1109/2211] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:37.664008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.671932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e160bca-7ae5-4287-9fad-395049c66145 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.677019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.677225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.678084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.678653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.679928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df274d-6d63-4865-b1fa-c019c2f5bb08 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.684819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.685465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.685747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.686553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.687422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.689026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.691040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.692968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.707117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1110/2212] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:37.708420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.714033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1103/2213] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:37.715267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.730808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdc34d-7dab-4743-8799-abdde6bf49af service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.734578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d0ba-2d1d-4877-b684-3f545eeb5a67 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.742225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.742856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.743133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.743403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.744037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.747152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.751768 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.753123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.753447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.753720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.754897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.759881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.789435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1111/2214] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:37.789435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.803092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1104/2215] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:37 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:37.804343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:37.816501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56902e24-91fd-40e6-996d-3a41b002f4d5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.837321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:37.954144 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b11c06-c583-4041-8bca-6036bc1cd043 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:37.961198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.962158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.962631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.962969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:37.964007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:37.967289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:37.983570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:37.984274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:37.984549 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:37.984829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] PATH_INFO: `/v3/projects/f91804b8d618416a9f4c52a315b797b8/users/560c34ab5b4d4b0f9aaf8f0e7932df7b/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.008687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1105/2216] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:38.013603 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.028880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73e07a-614a-460e-a665-e7f01f592f57 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.030178 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91804b8d618416a9f4c52a315b797b8, user_id=560c34ab5b4d4b0f9aaf8f0e7932df7b, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.033407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.034408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.035032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.035309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.035581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.037835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.040815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.059736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1112/2217] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:37 2022] PUT /identity/v3/projects/f91804b8d618416a9f4c52a315b797b8/users/560c34ab5b4d4b0f9aaf8f0e7932df7b/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:38.060763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.101732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1106/2218] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:38 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:38.101732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.122210 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b466e5-7c7f-4698-9d94-e89f8562ef61 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.173431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5b57-9192-48fd-99a2-fd54a095faaa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.180269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:38.180619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.181279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.181591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.182202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] PATH_INFO: `/v3/projects/158485c7396c414597453b74b78844ef/users/3aadac8427d64081a6ab6282465945d6/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.223863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158485c7396c414597453b74b78844ef, user_id=3aadac8427d64081a6ab6282465945d6, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.230658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.269566 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1113/2219] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:38 2022] PUT /identity/v3/projects/158485c7396c414597453b74b78844ef/users/3aadac8427d64081a6ab6282465945d6/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:38.270771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.314876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.315519 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.315799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.316076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.317091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.319415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.346078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1107/2220] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:38.346078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.346078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:38.369232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32ba4d-78ee-4b8d-aaf5-25fe145b3c67 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.379137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229845-fdaa-4234-b5a3-eabaa6562853 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.388258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.389063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.389339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.389762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] PATH_INFO: `/v3/projects/acb2a529552b40bab1a3f625253473ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.390787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385e459-e8a1-4d21-8768-71fb299214c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.391772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385e459-e8a1-4d21-8768-71fb299214c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.392409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385e459-e8a1-4d21-8768-71fb299214c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.392885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385e459-e8a1-4d21-8768-71fb299214c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.393844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385e459-e8a1-4d21-8768-71fb299214c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.395688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385e459-e8a1-4d21-8768-71fb299214c5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.396275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb2a529552b40bab1a3f625253473ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.399854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.417268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1114/2221] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:38.418897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.419192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.419456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.491665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] MFA Rules not processed for user `4da2d83be930445aa7ffba8e3a0116f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:38.494495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:38.502399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb2a529552b40bab1a3f625253473ce', 'request_id': 'req-82d0dc87-0cf2-4641-a3e3-6c53cd661876'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:38.517837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb2a529552b40bab1a3f625253473ce', 'request_id': 'req-82d0dc87-0cf2-4641-a3e3-6c53cd661876'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:38.518738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:38.552542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb2a529552b40bab1a3f625253473ce', 'request_id': 'req-82d0dc87-0cf2-4641-a3e3-6c53cd661876'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:38.576233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] The token cache is being invalidate because project acb2a529552b40bab1a3f625253473ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:38.576619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:38.577454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82d0dc87-0cf2-4641-a3e3-6c53cd661876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:38.579168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1108/2222] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:38 2022] DELETE /identity/v3/projects/acb2a529552b40bab1a3f625253473ce => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:38.582633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.582633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.582633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.597008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1115/2223] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:38.598535 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.602928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:38.622433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] MFA Rules not processed for user `3aadac8427d64081a6ab6282465945d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:38.624163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:38.720611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69b8d4-2418-454d-b11c-6e5433e77a00 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.737018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e20cdd-ad32-4f06-b18c-9f8936e56ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.737846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e20cdd-ad32-4f06-b18c-9f8936e56ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.738360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e20cdd-ad32-4f06-b18c-9f8936e56ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.738859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e20cdd-ad32-4f06-b18c-9f8936e56ffd admin admin] PATH_INFO: `/v3/projects/f91804b8d618416a9f4c52a315b797b8/users/560c34ab5b4d4b0f9aaf8f0e7932df7b/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.742165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e20cdd-ad32-4f06-b18c-9f8936e56ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91804b8d618416a9f4c52a315b797b8, user_id=560c34ab5b4d4b0f9aaf8f0e7932df7b, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.750950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e20cdd-ad32-4f06-b18c-9f8936e56ffd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.754977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1109/2224] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:38.757420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.761053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:38.772894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1116/2225] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:38 2022] PUT /identity/v3/projects/f91804b8d618416a9f4c52a315b797b8/users/560c34ab5b4d4b0f9aaf8f0e7932df7b/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:38.778475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.778846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.784117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.787458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed27d9-d220-4c2f-868a-e6fb1f03b14d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.816671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:38.818564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:38.851513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:38.903772 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c837ce-fdd5-48f1-973a-62e0029df606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.905195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c837ce-fdd5-48f1-973a-62e0029df606 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.905195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c837ce-fdd5-48f1-973a-62e0029df606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.905449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c837ce-fdd5-48f1-973a-62e0029df606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.906441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c837ce-fdd5-48f1-973a-62e0029df606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.908453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c837ce-fdd5-48f1-973a-62e0029df606 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.924130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1117/2226] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:38.925429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:38.927094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:38.939821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1110/2227] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:38.941217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f5c02-1ad8-4464-b369-109c9056f048 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.942303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f5c02-1ad8-4464-b369-109c9056f048 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.942654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f5c02-1ad8-4464-b369-109c9056f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.951924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830ae1-1c52-4a93-995e-c67f9230666a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:38.963679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27aec8-cdfa-457e-9570-0006d422d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:38.964506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aec8-cdfa-457e-9570-0006d422d6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:38.964789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aec8-cdfa-457e-9570-0006d422d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:38.965129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aec8-cdfa-457e-9570-0006d422d6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:38.965809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27aec8-cdfa-457e-9570-0006d422d6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:38.967868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27aec8-cdfa-457e-9570-0006d422d6f1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:38.983117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c27f5c02-1ad8-4464-b369-109c9056f048 None None] MFA Rules not processed for user `560c34ab5b4d4b0f9aaf8f0e7932df7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:38.984903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c27f5c02-1ad8-4464-b369-109c9056f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:39.036312 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1118/2228] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:38 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:39.037851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2630e-807c-41d5-a0d2-5f61a8f4d518 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.038153 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2630e-807c-41d5-a0d2-5f61a8f4d518 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.038425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2630e-807c-41d5-a0d2-5f61a8f4d518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.080944 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e5a2630e-807c-41d5-a0d2-5f61a8f4d518 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:39.083958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e5a2630e-807c-41d5-a0d2-5f61a8f4d518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:39.117053 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:39.163306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1111/2229] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:39.164254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f5c02-1ad8-4464-b369-109c9056f048 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.194815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f5c02-1ad8-4464-b369-109c9056f048 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.213422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1119/2230] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:39.214397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2630e-807c-41d5-a0d2-5f61a8f4d518 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.235246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2630e-807c-41d5-a0d2-5f61a8f4d518 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.249961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.250757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.251099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.251443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.252152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.254280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.298188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.298880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.299417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.299417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] PATH_INFO: `/v3/projects/c327c5a2bbd94c758fd6c46433ce02f7/users/842b63f13b8f4ed08db32e83b998e84a/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.306034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1120/2231] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:39 2022] POST /identity/v3/users => generated 311 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:39.306034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.308261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:39.324952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c327c5a2bbd94c758fd6c46433ce02f7, user_id=842b63f13b8f4ed08db32e83b998e84a, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.327690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.347835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1112/2232] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:39 2022] PUT /identity/v3/projects/c327c5a2bbd94c758fd6c46433ce02f7/users/842b63f13b8f4ed08db32e83b998e84a/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:39.357713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.400946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad84179-4938-4598-a589-dfb21fa718fd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.440695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:39.472748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.473392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.473667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.473931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.476294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:39.477988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a8fc-4dd2-4c19-b70b-ac6b41ff0c88 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.484678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.485354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.485975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.486260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.486936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:39.487326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.489246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.506684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1113/2233] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:39.507662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.518490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b22d5f-f273-40ae-9f9f-c27ee88ac045 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.524001 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dfce2-7d5e-4dfe-ade7-b521f02803ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.524664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dfce2-7d5e-4dfe-ade7-b521f02803ba admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.524944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dfce2-7d5e-4dfe-ade7-b521f02803ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.525299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dfce2-7d5e-4dfe-ade7-b521f02803ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.525990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dfce2-7d5e-4dfe-ade7-b521f02803ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.527664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dfce2-7d5e-4dfe-ade7-b521f02803ba admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.560734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1114/2234] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:39.561183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.562850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12095c-1b34-4a16-a00d-57f7118261ca None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.563358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12095c-1b34-4a16-a00d-57f7118261ca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.563644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12095c-1b34-4a16-a00d-57f7118261ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.564297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.579224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1121/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:39.580490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.594641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fbf4a-349d-4afb-881f-599c7b36edb7 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.602498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.603698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.604187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.604728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.605740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.608331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.635663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8b12095c-1b34-4a16-a00d-57f7118261ca None None] MFA Rules not processed for user `842b63f13b8f4ed08db32e83b998e84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:39.637220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8b12095c-1b34-4a16-a00d-57f7118261ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:39.702106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1122/2236] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:39 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:39.703558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.740529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:39.776758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1115/2237] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:39.779768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12095c-1b34-4a16-a00d-57f7118261ca None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.821395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12095c-1b34-4a16-a00d-57f7118261ca None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.900286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d5f11-fe5c-41e8-af7f-abeac37783aa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:39.908439 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.910132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.910617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.911082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] PATH_INFO: `/v3/projects/fd9520f38a4f440c8145c9143dd03217/users/3fc5fb5973e945448c8d9b11b6edd027/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.932209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:39.932835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:39.933114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:39.933414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:39.934073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.936303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.950280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9520f38a4f440c8145c9143dd03217, user_id=3fc5fb5973e945448c8d9b11b6edd027, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:39.954970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:39.983222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1116/2238] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:39 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:39.983222 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.983747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1123/2239] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:39 2022] PUT /identity/v3/projects/fd9520f38a4f440c8145c9143dd03217/users/3fc5fb5973e945448c8d9b11b6edd027/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:39.985013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:39.986158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:40.060898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:40.124316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccd35b-858b-4e70-9b99-eacc260fb3ad admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.139778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83fadc-0fd4-4873-90d9-3e381bfd148f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.174190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.175130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.175558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.176041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.176947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.178877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.230370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1124/2240] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:40.231561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:40.244438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87a212-e492-45ad-947b-b2a5bddedc8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.247263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87a212-e492-45ad-947b-b2a5bddedc8b service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.247549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87a212-e492-45ad-947b-b2a5bddedc8b service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.247824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87a212-e492-45ad-947b-b2a5bddedc8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.273550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6017-0c2d-40db-bd79-92be7f4e0e95 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.286676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.288222 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.289052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.289322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.290431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.307174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.324437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1125/2241] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:40.325377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:40.338012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f42f9-9445-4a88-9378-11e17abb7606 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.342987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.344910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.344910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.344910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.344910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.346538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.361414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1126/2242] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:40.361414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:40.377126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e315e-d725-4535-a49f-8037d3a05369 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.382619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.383503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.383942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.384259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] PATH_INFO: `/v3/projects/fd9520f38a4f440c8145c9143dd03217/users/3fc5fb5973e945448c8d9b11b6edd027/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.386217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9520f38a4f440c8145c9143dd03217, user_id=3fc5fb5973e945448c8d9b11b6edd027, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.387852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87a212-e492-45ad-947b-b2a5bddedc8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.388921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.389308 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87a212-e492-45ad-947b-b2a5bddedc8b service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.401359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1127/2243] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:40 2022] PUT /identity/v3/projects/fd9520f38a4f440c8145c9143dd03217/users/3fc5fb5973e945448c8d9b11b6edd027/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:40.411387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:40.411465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1117/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:40.412584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.412867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.413150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.451966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] MFA Rules not processed for user `3fc5fb5973e945448c8d9b11b6edd027`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:40.453751 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:40.464563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:40.491181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f173c2-9abd-4938-8763-9b6ce0be30cb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.496674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b47c3-6aa4-43fe-bacd-8fbf27732ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.497338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b47c3-6aa4-43fe-bacd-8fbf27732ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.497657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b47c3-6aa4-43fe-bacd-8fbf27732ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.497982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b47c3-6aa4-43fe-bacd-8fbf27732ed8 admin admin] PATH_INFO: `/v3/projects/8074a0abdc7149a99f92b834d4fa6559/users/40d0f3c8bf8b4eaa818aed3346eb2454/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.526698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b47c3-6aa4-43fe-bacd-8fbf27732ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8074a0abdc7149a99f92b834d4fa6559, user_id=40d0f3c8bf8b4eaa818aed3346eb2454, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.529479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b47c3-6aa4-43fe-bacd-8fbf27732ed8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.543708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1118/2245] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:40 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:40.555162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:40.556571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:40.562067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1128/2246] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:40 2022] PUT /identity/v3/projects/8074a0abdc7149a99f92b834d4fa6559/users/40d0f3c8bf8b4eaa818aed3346eb2454/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:40.574837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3013df-ad12-4997-9ad0-3e6ddbdf94b1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.581046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:40.582601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3013df-ad12-4997-9ad0-3e6ddbdf94b1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.582962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3013df-ad12-4997-9ad0-3e6ddbdf94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.632777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6a3013df-ad12-4997-9ad0-3e6ddbdf94b1 None None] MFA Rules not processed for user `40d0f3c8bf8b4eaa818aed3346eb2454`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:40.634122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6a3013df-ad12-4997-9ad0-3e6ddbdf94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:40.654088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9f26-a673-4033-a40d-7ff1f7b799c4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.725526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1129/2247] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:40.739552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.740810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.741405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.742249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.834848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.836595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.857277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1119/2248] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:40 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:40.920687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3013df-ad12-4997-9ad0-3e6ddbdf94b1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:40.937414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3013df-ad12-4997-9ad0-3e6ddbdf94b1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:40.947135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:40.948311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:40.948889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:40.949481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:40.962929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:40.965559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:40.995068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1130/2249] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:41.299797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:41.309402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfec857-269e-44d7-9cf2-fea57999fc03 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:41.313678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:41.314299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:41.314578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:41.314853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:41.388168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:41.390176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:41.402572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1120/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:41.811937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:41.822783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64ad4f-b552-4e6e-9c0e-8f9be40dfabd service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:41.827174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:41.827852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:41.828135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:41.828581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:41.830773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:41.931402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:41.933154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:41.943367 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1131/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:42.671290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:42.680683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d9fa0-2d94-4fc2-a9c6-ac1e24e0b970 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:42.684902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554720-67bf-4bb9-b1d6-fe5a279742b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:42.689547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554720-67bf-4bb9-b1d6-fe5a279742b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:42.689547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554720-67bf-4bb9-b1d6-fe5a279742b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:42.689547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554720-67bf-4bb9-b1d6-fe5a279742b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:42.707745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:42.760675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554720-67bf-4bb9-b1d6-fe5a279742b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:42.765498 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554720-67bf-4bb9-b1d6-fe5a279742b7 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:42.779529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1121/2252] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:44.567705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:44.625843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:44.655669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea027-2241-4aef-8d5d-4cca9f0b5360 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:44.665612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:44.666440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:44.666908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:44.667177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] PATH_INFO: `/v3/users/40d0f3c8bf8b4eaa818aed3346eb2454` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:44.668644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d0f3c8bf8b4eaa818aed3346eb2454)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:44.671742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:44.747835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d0f3c8bf8b4eaa818aed3346eb2454'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:44.757797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d0f3c8bf8b4eaa818aed3346eb2454'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:44.772118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d0f3c8bf8b4eaa818aed3346eb2454'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:44.772864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d0f3c8bf8b4eaa818aed3346eb2454'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:44.773552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d0f3c8bf8b4eaa818aed3346eb2454'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:44.787367 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1132/2253] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:44 2022] DELETE /identity/v3/users/40d0f3c8bf8b4eaa818aed3346eb2454 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:44.792049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:44.792565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:44.792565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:44.812091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:44.813348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:44.881698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1122/2254] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:44.892298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:44.894011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:44.960917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014faec3-5e31-4ffa-b636-2a9d253b4c6b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:44.966698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64031458-14c0-4956-b85b-6bc6eed1bcb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:44.967346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031458-14c0-4956-b85b-6bc6eed1bcb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:44.967621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031458-14c0-4956-b85b-6bc6eed1bcb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:44.967887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031458-14c0-4956-b85b-6bc6eed1bcb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:44.978982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64031458-14c0-4956-b85b-6bc6eed1bcb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:44.980693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64031458-14c0-4956-b85b-6bc6eed1bcb3 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:44.991902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1133/2255] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:45.300427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:45.309738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:45.327405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe526c-eef7-42e6-9e99-68b97aa2a197 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:45.333459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:45.334313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.334527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.334801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] PATH_INFO: `/v3/projects/8074a0abdc7149a99f92b834d4fa6559` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.336168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8074a0abdc7149a99f92b834d4fa6559)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:45.338186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:45.392837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8074a0abdc7149a99f92b834d4fa6559', 'request_id': 'req-0e249576-13a4-43fa-a251-8ca35be4ff49'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:45.399677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8074a0abdc7149a99f92b834d4fa6559', 'request_id': 'req-0e249576-13a4-43fa-a251-8ca35be4ff49'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:45.408665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8074a0abdc7149a99f92b834d4fa6559', 'request_id': 'req-0e249576-13a4-43fa-a251-8ca35be4ff49'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:45.419589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] The token cache is being invalidate because project 8074a0abdc7149a99f92b834d4fa6559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:45.419883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:45.420537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e249576-13a4-43fa-a251-8ca35be4ff49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:45.422247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1123/2256] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:45 2022] DELETE /identity/v3/projects/8074a0abdc7149a99f92b834d4fa6559 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:45.427327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c160-bdfe-4c26-af08-8d5c455a78e7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.427640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c160-bdfe-4c26-af08-8d5c455a78e7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.427912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c160-bdfe-4c26-af08-8d5c455a78e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.448645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5a40c160-bdfe-4c26-af08-8d5c455a78e7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:45.449891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5a40c160-bdfe-4c26-af08-8d5c455a78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:45.527184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1134/2257] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:45.529006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796982-5476-4e98-aaf4-7dc8a15b5f32 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.529301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796982-5476-4e98-aaf4-7dc8a15b5f32 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.529615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796982-5476-4e98-aaf4-7dc8a15b5f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.550973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1b796982-5476-4e98-aaf4-7dc8a15b5f32 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:45.552263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1b796982-5476-4e98-aaf4-7dc8a15b5f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:45.565849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c160-bdfe-4c26-af08-8d5c455a78e7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:45.575557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1124/2258] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:45.577230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c160-bdfe-4c26-af08-8d5c455a78e7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:45.586489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:45.586840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.587124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.587398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.588162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:45.588328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:45.590133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:45.592041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:45.610066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1135/2259] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:45.614335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796982-5476-4e98-aaf4-7dc8a15b5f32 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:45.624263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796982-5476-4e98-aaf4-7dc8a15b5f32 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:45.630420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:45.631237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.631680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.631968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.633404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:45.635015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:45.672039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1125/2260] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:45 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:45.672682 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:45.683930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067a3c7-d07d-468a-9036-76bb20e2c0f8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:45.782589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:45.783250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.783536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.783801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.784427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:45.786526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:45.810250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1136/2261] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:45 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:45.814590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:45.826071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef5a2b-88ea-488b-b6cd-95eea294ed04 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:45.831814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:45.832503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.832791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.833066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.833759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:45.835445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:45.838091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:45.854570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:45.855685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1126/2262] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:45.865679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ca775-18e3-4bf9-8a00-77601dc58ca8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:45.871650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ec0f-0481-461b-8567-7d13cf722c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:45.872279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ec0f-0481-461b-8567-7d13cf722c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.872581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ec0f-0481-461b-8567-7d13cf722c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.872840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ec0f-0481-461b-8567-7d13cf722c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.873569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ec0f-0481-461b-8567-7d13cf722c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:45.875179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ec0f-0481-461b-8567-7d13cf722c38 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:45.894256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1137/2263] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:45.899056 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:45.909571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca5e63-c7f2-4bf9-8ec7-493ecabbb099 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:45.914614 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:45.915277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.915555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.915827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] PATH_INFO: `/v3/projects/75cbffcc57164d9689c6e98a7c343eee/users/f36a028693b0421896b62552eeb9af61/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.935124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cbffcc57164d9689c6e98a7c343eee, user_id=f36a028693b0421896b62552eeb9af61, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:45.938164 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:45.953242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1127/2264] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:45 2022] PUT /identity/v3/projects/75cbffcc57164d9689c6e98a7c343eee/users/f36a028693b0421896b62552eeb9af61/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:45.958376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:45.958697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:45.958971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:45.981159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:45.982497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:46.052156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1138/2265] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:46.063100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:46.066058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:46.136427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49284ac6-c098-4df6-abe1-92f471a79816 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:46.141660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1392ab-e3e9-4569-8b18-d33988cbe4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:46.142615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1392ab-e3e9-4569-8b18-d33988cbe4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:46.142883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1392ab-e3e9-4569-8b18-d33988cbe4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:46.143159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1392ab-e3e9-4569-8b18-d33988cbe4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:46.156718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1392ab-e3e9-4569-8b18-d33988cbe4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:46.158551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1392ab-e3e9-4569-8b18-d33988cbe4e0 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:46.170286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1128/2266] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:46.834136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:46.836182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:46.848476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562e2e7-935a-4819-ae05-abb5b42a80a4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:46.856953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:46.857790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:46.858134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:46.858470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] PATH_INFO: `/v3/users/279a3863ce324e599ce0b9fb1c49d4b8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:46.859846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279a3863ce324e599ce0b9fb1c49d4b8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:46.861948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:46.963316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:46.963880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:46.963880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:46.973639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279a3863ce324e599ce0b9fb1c49d4b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:46.997080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279a3863ce324e599ce0b9fb1c49d4b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.022124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] MFA Rules not processed for user `f36a028693b0421896b62552eeb9af61`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:47.023751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:47.026440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279a3863ce324e599ce0b9fb1c49d4b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.027279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279a3863ce324e599ce0b9fb1c49d4b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.029132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.029677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fafaf68e-7ce9-4dc5-9722-fb542e4c5299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279a3863ce324e599ce0b9fb1c49d4b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.048491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1139/2267] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:46 2022] DELETE /identity/v3/users/279a3863ce324e599ce0b9fb1c49d4b8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:47.052932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:47.053226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:47.053520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:47.082766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:47.084553 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.135955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1129/2268] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:47.143791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:47.146028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.189969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1140/2269] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:47.191133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:47.194138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.243134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ae8bd-211c-40f1-999a-fad21badbb15 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:47.262095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71063a-d530-45a8-ab5f-895fa3391e30 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:47.265208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:47.266085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:47.266701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:47.266974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:47.267242 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:47.287691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:47.289910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:47.302742 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1141/2270] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:47.305963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3494193-0b13-4950-9a97-f1d9a5b848cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:47.306283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:47.306820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3494193-0b13-4950-9a97-f1d9a5b848cb service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:47.307202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3494193-0b13-4950-9a97-f1d9a5b848cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:47.307574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3494193-0b13-4950-9a97-f1d9a5b848cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:47.307793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.322694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd3215-1a3f-4eff-a578-9e6393be5fc5 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:47.328509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:47.329417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:47.329683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:47.330059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] PATH_INFO: `/v3/users/3aadac8427d64081a6ab6282465945d6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:47.333488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aadac8427d64081a6ab6282465945d6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:47.334025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:47.381023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3494193-0b13-4950-9a97-f1d9a5b848cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:47.383725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3494193-0b13-4950-9a97-f1d9a5b848cb service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:47.396189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1130/2271] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:47.400168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aadac8427d64081a6ab6282465945d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.409909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aadac8427d64081a6ab6282465945d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.426406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aadac8427d64081a6ab6282465945d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.427892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aadac8427d64081a6ab6282465945d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.429176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aadac8427d64081a6ab6282465945d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.449104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:47.461589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1142/2272] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:47 2022] DELETE /identity/v3/users/3aadac8427d64081a6ab6282465945d6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:47.462117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:47.462399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:47.464525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:47.491032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:47.492481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.572866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1131/2273] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:47.614909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:47.616809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.692184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:47.694057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:47.717959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8277d-3c0d-4d07-8088-10a494949297 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:47.732513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:47.734194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:47.734686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:47.735387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] PATH_INFO: `/v3/projects/7e0fa6b0d03c42768052e2e15b5804af` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:47.737863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0fa6b0d03c42768052e2e15b5804af)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:47.745170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbeb28-62ed-4c65-aa8a-a464babddd7f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:47.753232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:47.756499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:47.757139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:47.757528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:47.757808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:47.784176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:47.785807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:47.797353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1143/2274] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:47.834058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0fa6b0d03c42768052e2e15b5804af', 'request_id': 'req-212a10d7-3c4e-4e19-917c-0efd18f3c310'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.853358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0fa6b0d03c42768052e2e15b5804af', 'request_id': 'req-212a10d7-3c4e-4e19-917c-0efd18f3c310'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.869198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0fa6b0d03c42768052e2e15b5804af', 'request_id': 'req-212a10d7-3c4e-4e19-917c-0efd18f3c310'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.889438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:47.897741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] The token cache is being invalidate because project 7e0fa6b0d03c42768052e2e15b5804af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:47.899394 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.912454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:47.920739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1132/2275] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:47 2022] DELETE /identity/v3/projects/7e0fa6b0d03c42768052e2e15b5804af => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:47.921445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:47.932070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f59f13-8e1d-4a81-bc06-c70861fa27fc service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:48.007565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:48.008247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:48.008531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:48.008854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] PATH_INFO: `/v3/users/b56acc789a014988806b9b72f43b8bd7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:48.010098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56acc789a014988806b9b72f43b8bd7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:48.012411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:48.096770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56acc789a014988806b9b72f43b8bd7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.110925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56acc789a014988806b9b72f43b8bd7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.127591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56acc789a014988806b9b72f43b8bd7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.128467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56acc789a014988806b9b72f43b8bd7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.129082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56acc789a014988806b9b72f43b8bd7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.143251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1144/2276] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:47 2022] DELETE /identity/v3/users/b56acc789a014988806b9b72f43b8bd7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:48.208565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:48.210393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:48.232385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a10d7-3c4e-4e19-917c-0efd18f3c310 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:48.308948 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:48.309770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:48.310052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:48.310324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] PATH_INFO: `/v3/projects/158485c7396c414597453b74b78844ef` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:48.311454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=158485c7396c414597453b74b78844ef)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:48.313625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:48.377097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158485c7396c414597453b74b78844ef', 'request_id': 'req-58c29723-3b61-4f02-be24-8780373228bf'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.384286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158485c7396c414597453b74b78844ef', 'request_id': 'req-58c29723-3b61-4f02-be24-8780373228bf'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.399369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158485c7396c414597453b74b78844ef', 'request_id': 'req-58c29723-3b61-4f02-be24-8780373228bf'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.411793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] The token cache is being invalidate because project 158485c7396c414597453b74b78844ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:48.412084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.412710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.414650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1133/2277] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:48 2022] DELETE /identity/v3/projects/158485c7396c414597453b74b78844ef => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:48.418850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:48.420286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:48.434147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd1b5-5eb5-44a1-82ea-b3148c7c239a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:48.455658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:48.499692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:48.501335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:48.513016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:48.513016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:48.513443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:48.513530 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] PATH_INFO: `/v3/users/3fc5fb5973e945448c8d9b11b6edd027` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:48.514718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc5fb5973e945448c8d9b11b6edd027)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:48.516898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:48.575542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc5fb5973e945448c8d9b11b6edd027'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.583376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc5fb5973e945448c8d9b11b6edd027'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.589626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29723-3b61-4f02-be24-8780373228bf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:48.594653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:48.595327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:48.595643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:48.595903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc5fb5973e945448c8d9b11b6edd027'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.596010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] PATH_INFO: `/v3/projects/663ce7ec26bc44448f712d631f788894` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:48.597023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc5fb5973e945448c8d9b11b6edd027'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.597258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663ce7ec26bc44448f712d631f788894)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:48.599353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:48.599700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc5fb5973e945448c8d9b11b6edd027'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.614152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1145/2278] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:48 2022] DELETE /identity/v3/users/3fc5fb5973e945448c8d9b11b6edd027 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:48.646687 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:48.662092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663ce7ec26bc44448f712d631f788894', 'request_id': 'req-d1430d78-aa56-48b6-a60c-8019599be845'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.669201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663ce7ec26bc44448f712d631f788894', 'request_id': 'req-d1430d78-aa56-48b6-a60c-8019599be845'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.679328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663ce7ec26bc44448f712d631f788894', 'request_id': 'req-d1430d78-aa56-48b6-a60c-8019599be845'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.698231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] The token cache is being invalidate because project 663ce7ec26bc44448f712d631f788894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:48.698533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.699487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:48.702437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1134/2279] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:48 2022] DELETE /identity/v3/projects/663ce7ec26bc44448f712d631f788894 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:48.706151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:48.707790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:48.823890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2ce62-7088-495a-8398-771c3cb5f2d5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:48.906436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:48.949759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:48.952813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:48.956148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:48.957933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:48.960905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:48.962783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] PATH_INFO: `/v3/users/560c34ab5b4d4b0f9aaf8f0e7932df7b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:48.967114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560c34ab5b4d4b0f9aaf8f0e7932df7b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:48.977442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1430d78-aa56-48b6-a60c-8019599be845 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:48.977646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:48.997291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:48.998843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.000753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.001044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] PATH_INFO: `/v3/projects/fd9520f38a4f440c8145c9143dd03217` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.003513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9520f38a4f440c8145c9143dd03217)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:49.006135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:49.091284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560c34ab5b4d4b0f9aaf8f0e7932df7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.114245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560c34ab5b4d4b0f9aaf8f0e7932df7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.152923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560c34ab5b4d4b0f9aaf8f0e7932df7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.154528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560c34ab5b4d4b0f9aaf8f0e7932df7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.155423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b59665ac-a438-46c5-98af-ecbd853201a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560c34ab5b4d4b0f9aaf8f0e7932df7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.176414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1146/2280] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:48 2022] DELETE /identity/v3/users/560c34ab5b4d4b0f9aaf8f0e7932df7b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:49.179604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9f23-daea-4775-8e70-7b9e82938510 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.182165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9f23-daea-4775-8e70-7b9e82938510 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.182998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9f23-daea-4775-8e70-7b9e82938510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.217144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9cef9f23-daea-4775-8e70-7b9e82938510 None None] MFA Rules not processed for user `f36a028693b0421896b62552eeb9af61`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:49.219412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9cef9f23-daea-4775-8e70-7b9e82938510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:49.260565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9520f38a4f440c8145c9143dd03217', 'request_id': 'req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.278031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9520f38a4f440c8145c9143dd03217', 'request_id': 'req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.298673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9520f38a4f440c8145c9143dd03217', 'request_id': 'req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.321819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] The token cache is being invalidate because project fd9520f38a4f440c8145c9143dd03217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:49.322120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.323293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bfb9a8ea-d45d-48eb-8b59-d66853e184ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:49.326512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1135/2281] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:48 2022] DELETE /identity/v3/projects/fd9520f38a4f440c8145c9143dd03217 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:49.341711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab44087-23ed-4a4a-8a52-82f0fab434e7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.341711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab44087-23ed-4a4a-8a52-82f0fab434e7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.341711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab44087-23ed-4a4a-8a52-82f0fab434e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.358374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1147/2282] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:49.386027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0ab44087-23ed-4a4a-8a52-82f0fab434e7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:49.387513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0ab44087-23ed-4a4a-8a52-82f0fab434e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:49.483988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1136/2283] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:49.493024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d477a5-82c4-4203-8899-c5852974bc87 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.493405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d477a5-82c4-4203-8899-c5852974bc87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.493835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d477a5-82c4-4203-8899-c5852974bc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.537541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-58d477a5-82c4-4203-8899-c5852974bc87 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:49.539684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-58d477a5-82c4-4203-8899-c5852974bc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:49.552131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1148/2284] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:49.555060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab44087-23ed-4a4a-8a52-82f0fab434e7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:49.567364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab44087-23ed-4a4a-8a52-82f0fab434e7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:49.573482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:49.575125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.576155 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.576633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.577518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:49.578158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:49.581032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:49.610824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1137/2285] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:34:49.611663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d477a5-82c4-4203-8899-c5852974bc87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:49.631312 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d477a5-82c4-4203-8899-c5852974bc87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:49.638987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:49.640766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.641185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.641587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.645163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:49.650739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:49.716669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1149/2286] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:49 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:49.718844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:49.730283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:49.732671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:49.738021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae147-bdda-4a03-97fe-3a0e5225a80f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:49.831984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:49.839238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:49.877228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc63f-c20f-48ad-ba21-2d4d6b356963 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:49.884037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:49.884898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.885527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.885925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] PATH_INFO: `/v3/projects/f91804b8d618416a9f4c52a315b797b8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.890529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91804b8d618416a9f4c52a315b797b8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:49.896410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:49.902359 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:49.903311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:49.903591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:49.903864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:49.904507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:49.906485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:49.964935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1138/2287] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:49 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:49.969808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:49.981808 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e42dcb-c9f1-40ac-9767-77d71e3c0f8d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.003207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91804b8d618416a9f4c52a315b797b8', 'request_id': 'req-02887f79-ab7e-4973-bb37-98b77359dace'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:50.013538 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91804b8d618416a9f4c52a315b797b8', 'request_id': 'req-02887f79-ab7e-4973-bb37-98b77359dace'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:50.027054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91804b8d618416a9f4c52a315b797b8', 'request_id': 'req-02887f79-ab7e-4973-bb37-98b77359dace'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:50.043420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] The token cache is being invalidate because project f91804b8d618416a9f4c52a315b797b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:50.043950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:50.044436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-02887f79-ab7e-4973-bb37-98b77359dace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:50.046407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1150/2288] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:49 2022] DELETE /identity/v3/projects/f91804b8d618416a9f4c52a315b797b8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:50.051365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c88b96-7a97-4911-b1ba-da08cd393417 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.051628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c88b96-7a97-4911-b1ba-da08cd393417 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.051906 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c88b96-7a97-4911-b1ba-da08cd393417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.076370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a1c88b96-7a97-4911-b1ba-da08cd393417 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:50.077617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a1c88b96-7a97-4911-b1ba-da08cd393417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:50.085490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.086753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.087209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.087801 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.090686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.092402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.117695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1139/2289] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:50.126398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.128752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:50.144797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a167-e3fb-44eb-957f-c6a66551c433 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.150386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.151371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.151656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.151929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.152579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.154692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.172975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1140/2290] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:50.174138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.186742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf775d6-0eed-457c-b6e1-027f4b9dea59 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.195776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1151/2291] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:50.206865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00399844-6228-4a44-ade7-dbef71d86afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.207280 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2223-11d4-4fd1-8f7d-33460ed978c3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.207638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2223-11d4-4fd1-8f7d-33460ed978c3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.208012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2223-11d4-4fd1-8f7d-33460ed978c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.208665 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00399844-6228-4a44-ade7-dbef71d86afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.209167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00399844-6228-4a44-ade7-dbef71d86afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.210934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00399844-6228-4a44-ade7-dbef71d86afb admin admin] PATH_INFO: `/v3/projects/0734494b0a5d482f937dc5d8d42038eb/users/1fa9757f7f474ee2af57300df632295d/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.229146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00399844-6228-4a44-ade7-dbef71d86afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0734494b0a5d482f937dc5d8d42038eb, user_id=1fa9757f7f474ee2af57300df632295d, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.233342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00399844-6228-4a44-ade7-dbef71d86afb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.235568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f7fd2223-11d4-4fd1-8f7d-33460ed978c3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:50.236954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f7fd2223-11d4-4fd1-8f7d-33460ed978c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:50.247621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1152/2292] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:50.252163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd2223-11d4-4fd1-8f7d-33460ed978c3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.263546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd2223-11d4-4fd1-8f7d-33460ed978c3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.287457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1141/2293] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:50 2022] PUT /identity/v3/projects/0734494b0a5d482f937dc5d8d42038eb/users/1fa9757f7f474ee2af57300df632295d/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:50.298162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e90e-2725-4f39-96b2-4584b36d4317 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.298480 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e90e-2725-4f39-96b2-4584b36d4317 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.298830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e90e-2725-4f39-96b2-4584b36d4317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.339431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4076e90e-2725-4f39-96b2-4584b36d4317 None None] MFA Rules not processed for user `1fa9757f7f474ee2af57300df632295d`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:50.340820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4076e90e-2725-4f39-96b2-4584b36d4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:50.415489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.416286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.417200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.417573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.418308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:50.418699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.422313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.439403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1153/2294] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:50.445022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.451174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:50.456846 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5bf4-b0c3-4fad-9224-52a266ba030f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.466562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1142/2295] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:50.471957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076e90e-2725-4f39-96b2-4584b36d4317 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.474431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.475067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.475350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.475623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.476984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.480304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.485156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076e90e-2725-4f39-96b2-4584b36d4317 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.491139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.492112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.492390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.492811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.493532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.495583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.507819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:50.536661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1143/2297] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:50 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:50.536878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1154/2297] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:50 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:50.540763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.543766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.626766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec2bb-1af0-4537-bc53-1f7796a50883 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.644688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa225-ae6e-4bfe-9ddc-d1d48b1891f3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.650639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.651855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.652573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.652805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.653569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.655798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.685587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1144/2298] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:50 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:50.689300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.723146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf5a8c-8d5b-43b3-9096-b4de9e4d7e45 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.727975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.728919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.729498 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.730012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.730953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.733253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.740851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.742014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.742711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.742711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.743473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.745567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.773584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1155/2299] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:50 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:50.776745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.785197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1145/2300] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:50.789130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c663d5-c1de-42eb-9134-e66fd798b88d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.794346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.795308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.795953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.796228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.796500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.797354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.799618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.813817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1156/2301] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:50.815350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.829406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87bd37-dd65-42a8-a480-4589cbb9a4d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.837262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.838083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.838598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.838966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.839839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.842134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.860005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1157/2302] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:50.862534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f285ff-ffbb-444e-a2c9-34cb6962236f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.870385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.884983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.889277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.889277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.889277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] PATH_INFO: `/v3/projects/55990c42a33f4e08a10eb1f911819323/users/67f0bf4445e94c3f838906cfebdd3e4e/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.893972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106398-57c5-4f7a-b712-45a7a3e117fe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:50.918886 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55990c42a33f4e08a10eb1f911819323, user_id=67f0bf4445e94c3f838906cfebdd3e4e, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.924096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:50.926026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615640-0b36-44f3-9163-3af67f223c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:50.926927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615640-0b36-44f3-9163-3af67f223c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:50.927252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615640-0b36-44f3-9163-3af67f223c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:50.927770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615640-0b36-44f3-9163-3af67f223c0e admin admin] PATH_INFO: `/v3/projects/64f028cfc9ac4cc0805809e63532fe0e/users/034db150f17047fe8debd09f8820bc5b/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:50.947039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1146/2303] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:50 2022] PUT /identity/v3/projects/55990c42a33f4e08a10eb1f911819323/users/67f0bf4445e94c3f838906cfebdd3e4e/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:50.950760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:50.964355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615640-0b36-44f3-9163-3af67f223c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f028cfc9ac4cc0805809e63532fe0e, user_id=034db150f17047fe8debd09f8820bc5b, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:50.972778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615640-0b36-44f3-9163-3af67f223c0e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.004187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1158/2304] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:50 2022] PUT /identity/v3/projects/64f028cfc9ac4cc0805809e63532fe0e/users/034db150f17047fe8debd09f8820bc5b/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:51.013813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acfeb-2d5e-4642-8de2-af7640404409 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.014129 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acfeb-2d5e-4642-8de2-af7640404409 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.014557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acfeb-2d5e-4642-8de2-af7640404409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.030972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868de6af-c47b-40fa-97c8-bb6e6dae1368 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.044078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8a6acfeb-2d5e-4642-8de2-af7640404409 None None] MFA Rules not processed for user `034db150f17047fe8debd09f8820bc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:51.045994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8a6acfeb-2d5e-4642-8de2-af7640404409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:51.068020 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:51.081240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:51.093999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.094707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.095189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.095571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.096344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.098251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.114424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1147/2305] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:51.115559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.127583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9bb89-46f8-47a5-ae6c-05fb2aab16d0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.135784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1159/2306] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:51.139905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757304b-de4e-4fb0-aa06-7f57975cd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.140773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757304b-de4e-4fb0-aa06-7f57975cd959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.141051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757304b-de4e-4fb0-aa06-7f57975cd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.141324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757304b-de4e-4fb0-aa06-7f57975cd959 admin admin] PATH_INFO: `/v3/projects/55990c42a33f4e08a10eb1f911819323/users/67f0bf4445e94c3f838906cfebdd3e4e/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.141499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6acfeb-2d5e-4642-8de2-af7640404409 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.143798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757304b-de4e-4fb0-aa06-7f57975cd959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55990c42a33f4e08a10eb1f911819323, user_id=67f0bf4445e94c3f838906cfebdd3e4e, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.146615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757304b-de4e-4fb0-aa06-7f57975cd959 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.153175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6acfeb-2d5e-4642-8de2-af7640404409 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.158929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1148/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:51 2022] PUT /identity/v3/projects/55990c42a33f4e08a10eb1f911819323/users/67f0bf4445e94c3f838906cfebdd3e4e/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:51.171288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.171636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.171923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.207331 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] MFA Rules not processed for user `67f0bf4445e94c3f838906cfebdd3e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:51.208607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:51.228112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.229149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.229639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.229855 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.232503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.233263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.270265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1160/2308] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:51 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:51.271145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.290376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1149/2309] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:51.302929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.304868 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:51.350370 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2371e-e5f3-47ae-a421-5f5c01dab9b0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.355933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.356871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.357437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.357874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.358915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.361232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.397438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1d72-59e3-4278-9f80-fa7dd5284c48 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.407541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1161/2310] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:51 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:51.411477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.421390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1a11-0827-4272-94c4-3b08415a866e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.426480 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.427104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.427453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.427781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.428658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.430997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.446675 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1162/2311] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:51.450338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.460545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9dda1-a971-45ef-a8ac-31f83543d62e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.466590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.467211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.467485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.467933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.468475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.470120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.480428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.480428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.480428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.480428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.483141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1163/2312] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:51.486767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.501105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf67aac-f1ae-4545-a1e8-335f7ebf0557 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.518403 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403d7a4-d0bd-4b36-8d28-72cb7a72ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.520130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d7a4-d0bd-4b36-8d28-72cb7a72ba2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.520600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d7a4-d0bd-4b36-8d28-72cb7a72ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.521157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d7a4-d0bd-4b36-8d28-72cb7a72ba2d admin admin] PATH_INFO: `/v3/projects/58f3ce6ae414470c979703eb760a4ab1/users/0f4c5132b3f040d398954068ac33b036/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.536179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:51.542001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:51.556153 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403d7a4-d0bd-4b36-8d28-72cb7a72ba2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f3ce6ae414470c979703eb760a4ab1, user_id=0f4c5132b3f040d398954068ac33b036, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.559592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403d7a4-d0bd-4b36-8d28-72cb7a72ba2d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.581255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.582386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1164/2313] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:51 2022] PUT /identity/v3/projects/58f3ce6ae414470c979703eb760a4ab1/users/0f4c5132b3f040d398954068ac33b036/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:51.583470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.599820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc041a-20fa-46f2-b1f8-7993ac19a99d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.600218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc041a-20fa-46f2-b1f8-7993ac19a99d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.600609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc041a-20fa-46f2-b1f8-7993ac19a99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.603191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1150/2314] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:51.647922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e2bc041a-20fa-46f2-b1f8-7993ac19a99d None None] MFA Rules not processed for user `0f4c5132b3f040d398954068ac33b036`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:51.652295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e2bc041a-20fa-46f2-b1f8-7993ac19a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:51.717550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.727597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062d78-12c9-4cc7-b5c9-31366ad5da2f service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.749424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1165/2315] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:51.754204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc041a-20fa-46f2-b1f8-7993ac19a99d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.802677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.803548 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.804160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.804608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.845109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc041a-20fa-46f2-b1f8-7993ac19a99d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.853096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.854146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.854798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.855073 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.856631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.860227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.889875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.891477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.896388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1166/2316] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:51 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:51.897410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:51.902874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1151/2317] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:51.977103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e7ef-1898-41a7-985d-a60be25f6a72 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:51.981859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:51.982505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:51.982782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:51.983059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:51.983687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:51.985729 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:51.997847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:52.030199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1167/2318] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:51 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:52.034874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:52.053590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef3d5b-fc52-499e-ab70-7a8cbfb1a5b2 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:52.061880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:52.062944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:52.063539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:52.064138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:52.065010 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:52.068713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:52.089856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1152/2319] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:52.097986 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:52.112706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1ed08-49c5-40e9-b9d9-16e347482574 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:52.121561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:52.122318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:52.122602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:52.123401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] PATH_INFO: `/v3/projects/827d4591f34f48968c05b15c00bad73f/users/333e80318e6d4387b28e437123770097/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:52.148126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] RBAC: Authorizing `identity:create_grant(project_id=827d4591f34f48968c05b15c00bad73f, user_id=333e80318e6d4387b28e437123770097, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:52.151270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:52.179850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1168/2320] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:52 2022] PUT /identity/v3/projects/827d4591f34f48968c05b15c00bad73f/users/333e80318e6d4387b28e437123770097/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:52.184287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:52.205327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b5aed-7948-48d9-98b4-2d121a51b50f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:52.317515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e355e2-c71c-4c92-a32f-529038fa1f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:52.317515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e355e2-c71c-4c92-a32f-529038fa1f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:52.317515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e355e2-c71c-4c92-a32f-529038fa1f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:52.317515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e355e2-c71c-4c92-a32f-529038fa1f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:52.318544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e355e2-c71c-4c92-a32f-529038fa1f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:52.318544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e355e2-c71c-4c92-a32f-529038fa1f35 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:52.352375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1153/2321] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:52.354013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:52.367130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c92be-b131-46d5-85ca-86dd4576896f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:52.375138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:52.376745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:52.377121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:52.377612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] PATH_INFO: `/v3/projects/827d4591f34f48968c05b15c00bad73f/users/333e80318e6d4387b28e437123770097/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:52.381189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827d4591f34f48968c05b15c00bad73f, user_id=333e80318e6d4387b28e437123770097, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:52.384904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:52.400333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1169/2322] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:52 2022] PUT /identity/v3/projects/827d4591f34f48968c05b15c00bad73f/users/333e80318e6d4387b28e437123770097/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:52.409401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:52.409678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:52.409953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:52.434589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:52.474224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] MFA Rules not processed for user `333e80318e6d4387b28e437123770097`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:52.480136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:52.579715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1154/2323] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:52.592635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:52.676617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234116a0-e6cf-44d2-b7e8-3997294be7a6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:52.681601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:52.682224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:52.682502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:52.682778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:52.770248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:52.771847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:52.783822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1170/2324] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:54.439198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:54.441225 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:54.459206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade81451-7ba5-4dcd-a0ac-487f57530ca5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:54.466113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:54.467573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:54.468084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:54.468575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:54.548432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:54.550095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:54.570993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1155/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:55.437273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:55.447155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe21a0-aa3d-4bf2-8b59-a80c8a377b6e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:55.456512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c61a-13a9-460c-9c45-49064d43877a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:55.457199 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c61a-13a9-460c-9c45-49064d43877a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:55.457492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c61a-13a9-460c-9c45-49064d43877a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:55.457770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c61a-13a9-460c-9c45-49064d43877a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:55.472492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c61a-13a9-460c-9c45-49064d43877a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:55.475399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c61a-13a9-460c-9c45-49064d43877a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:55.501007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1171/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:55.635198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:55.639271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:55.773139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ced2-2f50-4334-9de5-c7c0a387a783 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:55.778896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:55.779605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:55.780059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:55.780522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] PATH_INFO: `/v3/users/93dfcce68af441a995cd62c31339edca` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:55.782051 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dfcce68af441a995cd62c31339edca)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:55.785073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:55.823374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:55.845491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dfcce68af441a995cd62c31339edca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:55.855820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dfcce68af441a995cd62c31339edca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:55.856787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dfcce68af441a995cd62c31339edca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:55.878558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dfcce68af441a995cd62c31339edca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:55.879796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dfcce68af441a995cd62c31339edca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:55.899565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1156/2327] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:55 2022] DELETE /identity/v3/users/93dfcce68af441a995cd62c31339edca => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:55.905340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:55.906059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:55.906477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:55.951991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:55.960715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:56.016652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:56.028415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1172/2328] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:56.039435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:56.043856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:56.105069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab571-96e3-4f6d-851d-00eb02bcb4ab admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:56.109568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b34aa-58d9-48f4-8dfb-103bd0766cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:56.110642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b34aa-58d9-48f4-8dfb-103bd0766cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.110642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b34aa-58d9-48f4-8dfb-103bd0766cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.110907 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b34aa-58d9-48f4-8dfb-103bd0766cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.125021 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b34aa-58d9-48f4-8dfb-103bd0766cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:56.126508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b34aa-58d9-48f4-8dfb-103bd0766cb1 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:56.136953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1157/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:34:56.435121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:56.436645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:56.455501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd80c78-1322-4e3d-8a92-ad69f0ce1490 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:56.461022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:56.461837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.462241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.462612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] PATH_INFO: `/v3/projects/11295c6e01564793b26eeddfb2122894` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.463997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11295c6e01564793b26eeddfb2122894)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:56.466160 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:56.521256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11295c6e01564793b26eeddfb2122894', 'request_id': 'req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:56.528985 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11295c6e01564793b26eeddfb2122894', 'request_id': 'req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:56.541763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11295c6e01564793b26eeddfb2122894', 'request_id': 'req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:56.556616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] The token cache is being invalidate because project 11295c6e01564793b26eeddfb2122894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:56.557231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:56.558393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-50fa14d7-91bf-48d2-86a5-9101f9e3dd15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:56.560534 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1173/2330] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:56 2022] DELETE /identity/v3/projects/11295c6e01564793b26eeddfb2122894 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:56.566134 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899b3e-6974-4d6c-affd-9f90ea940239 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.566852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899b3e-6974-4d6c-affd-9f90ea940239 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.567127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899b3e-6974-4d6c-affd-9f90ea940239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.589346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c4899b3e-6974-4d6c-affd-9f90ea940239 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:56.590643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c4899b3e-6974-4d6c-affd-9f90ea940239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:56.658937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1158/2331] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:56.668657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca780-45da-4309-9cc0-e674436c43be None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.668947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca780-45da-4309-9cc0-e674436c43be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.669217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca780-45da-4309-9cc0-e674436c43be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.691223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a66ca780-45da-4309-9cc0-e674436c43be None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:56.692769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a66ca780-45da-4309-9cc0-e674436c43be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:56.703258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1174/2332] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:56.707642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899b3e-6974-4d6c-affd-9f90ea940239 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:56.718718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899b3e-6974-4d6c-affd-9f90ea940239 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:56.723753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:56.724828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.724828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.725037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.725650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:56.725977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:56.727780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:56.747503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ca780-45da-4309-9cc0-e674436c43be None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:56.752492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1159/2333] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:56.758484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ca780-45da-4309-9cc0-e674436c43be None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:56.764542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:56.765276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.766151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.766151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.766890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:56.768987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:56.805872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1175/2334] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:56 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:56.807089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:56.817327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121340b1-af64-4879-8299-13e0ffd28ee5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:56.851992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:56.880184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:56.880853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.881075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.881344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.882055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:56.883974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:56.907512 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1160/2335] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:56 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:34:56.912093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:56.923308 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f709e0-5c48-4f08-b848-ee7774131fff admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:56.928076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:56.928887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.929236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.929633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.930351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:56.932016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:56.943311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1176/2336] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:56.947746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:56.959448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b0a76-8b8b-4789-aebf-544b62b3be0e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:56.967230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be24f8-6dd7-4f24-be08-68a7add46317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:56.967230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be24f8-6dd7-4f24-be08-68a7add46317 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:56.967230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be24f8-6dd7-4f24-be08-68a7add46317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:56.967556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be24f8-6dd7-4f24-be08-68a7add46317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:56.970364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be24f8-6dd7-4f24-be08-68a7add46317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:56.972129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be24f8-6dd7-4f24-be08-68a7add46317 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:56.991184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1161/2337] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:34:56.992935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:57.003317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7ed4-dbb1-4c51-a2a3-335b4edbd697 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:57.009334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:57.010599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:57.010877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:57.011200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] PATH_INFO: `/v3/projects/12a9b2e89a1f438da5c0610494cb9adf/users/45d1bd77a13a4bf7b0350816763b62c1/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:57.060602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a9b2e89a1f438da5c0610494cb9adf, user_id=45d1bd77a13a4bf7b0350816763b62c1, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:57.064880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:57.091766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1177/2338] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:56 2022] PUT /identity/v3/projects/12a9b2e89a1f438da5c0610494cb9adf/users/45d1bd77a13a4bf7b0350816763b62c1/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:57.104009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:57.104562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:57.105320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:57.158406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] MFA Rules not processed for user `45d1bd77a13a4bf7b0350816763b62c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:57.160270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:57.245443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1162/2339] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:57.256602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:57.258573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:57.334415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08476490-e973-4806-807c-3c02b9fcceb8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:57.339588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda5ace-065a-444c-a243-27c4248f0b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:57.340211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5ace-065a-444c-a243-27c4248f0b5a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:57.341042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5ace-065a-444c-a243-27c4248f0b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:57.341314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5ace-065a-444c-a243-27c4248f0b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:57.352564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda5ace-065a-444c-a243-27c4248f0b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:57.354092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda5ace-065a-444c-a243-27c4248f0b5a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:57.369201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1178/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:57.517727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:57.519575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:57.605561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e9f74-b158-40ff-95b4-2cd0e8dbc49a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:57.610075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:57.610720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:57.610999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:57.611280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] PATH_INFO: `/v3/users/1fa9757f7f474ee2af57300df632295d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:57.612857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa9757f7f474ee2af57300df632295d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:57.614830 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:57.679067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa9757f7f474ee2af57300df632295d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:57.681797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:57.697045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa9757f7f474ee2af57300df632295d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:57.697950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa9757f7f474ee2af57300df632295d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:57.718375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa9757f7f474ee2af57300df632295d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:57.719118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa9757f7f474ee2af57300df632295d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:57.732629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1163/2341] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:57 2022] DELETE /identity/v3/users/1fa9757f7f474ee2af57300df632295d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:57.737147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:57.737689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:57.737785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:57.757913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:57.759120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:57.771646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:57.829000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1179/2342] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:57.840371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:57.841973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:57.901568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff587-a92f-445d-850f-c3086b78c28d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:57.905315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:57.906207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:57.906499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:57.906915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:57.916873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:57.918502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:57.928494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1164/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:58.245676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:58.247456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:58.260206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95315377-a73c-49e2-b6a1-1dca8b97e134 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:58.264805 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:58.265471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:58.265783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:58.266095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] PATH_INFO: `/v3/projects/0734494b0a5d482f937dc5d8d42038eb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:58.267296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0734494b0a5d482f937dc5d8d42038eb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:58.269418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:58.326575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0734494b0a5d482f937dc5d8d42038eb', 'request_id': 'req-18979c16-4555-4204-a26f-b29256cdabf0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.333361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0734494b0a5d482f937dc5d8d42038eb', 'request_id': 'req-18979c16-4555-4204-a26f-b29256cdabf0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.343569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0734494b0a5d482f937dc5d8d42038eb', 'request_id': 'req-18979c16-4555-4204-a26f-b29256cdabf0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.357271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] The token cache is being invalidate because project 0734494b0a5d482f937dc5d8d42038eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:58.357688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.358557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-18979c16-4555-4204-a26f-b29256cdabf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.360383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1180/2344] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:58 2022] DELETE /identity/v3/projects/0734494b0a5d482f937dc5d8d42038eb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:58.364814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:58.377514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a2521-c3a4-4fee-ab78-a7e9982ba8eb service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:58.482611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:58.483401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:58.483622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:58.483890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] PATH_INFO: `/v3/users/67f0bf4445e94c3f838906cfebdd3e4e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:58.485136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f0bf4445e94c3f838906cfebdd3e4e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:58.487252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:58.560737 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f0bf4445e94c3f838906cfebdd3e4e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.572834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f0bf4445e94c3f838906cfebdd3e4e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.573676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f0bf4445e94c3f838906cfebdd3e4e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.586430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:58.587874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f0bf4445e94c3f838906cfebdd3e4e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.588683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f0bf4445e94c3f838906cfebdd3e4e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:58.604979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1165/2345] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:58 2022] DELETE /identity/v3/users/67f0bf4445e94c3f838906cfebdd3e4e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:58.806904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc0b15-8778-446d-9f1c-b535eee66468 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:58.807410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc0b15-8778-446d-9f1c-b535eee66468 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:58.807655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc0b15-8778-446d-9f1c-b535eee66468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:58.835707 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-12cc0b15-8778-446d-9f1c-b535eee66468 None None] MFA Rules not processed for user `45d1bd77a13a4bf7b0350816763b62c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:58.837487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-12cc0b15-8778-446d-9f1c-b535eee66468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:58.930517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1181/2346] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:58.954839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:58.956302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:59.055562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52bb2a-665b-416b-8924-e347645a274e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.064555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.065471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.065858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.066274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] PATH_INFO: `/v3/projects/55990c42a33f4e08a10eb1f911819323` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.068510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55990c42a33f4e08a10eb1f911819323)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.071257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.141417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55990c42a33f4e08a10eb1f911819323', 'request_id': 'req-b91f67cb-ec0f-43a9-b490-94dd970e68a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.148429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55990c42a33f4e08a10eb1f911819323', 'request_id': 'req-b91f67cb-ec0f-43a9-b490-94dd970e68a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.156642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55990c42a33f4e08a10eb1f911819323', 'request_id': 'req-b91f67cb-ec0f-43a9-b490-94dd970e68a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.168617 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] The token cache is being invalidate because project 55990c42a33f4e08a10eb1f911819323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:59.168906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.169600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b91f67cb-ec0f-43a9-b490-94dd970e68a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.171292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1166/2347] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:58 2022] DELETE /identity/v3/projects/55990c42a33f4e08a10eb1f911819323 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:59.176945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380bbfa-d2ae-40bc-acdc-1da3dcc0f090 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.176945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380bbfa-d2ae-40bc-acdc-1da3dcc0f090 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.176945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380bbfa-d2ae-40bc-acdc-1da3dcc0f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.197551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7380bbfa-d2ae-40bc-acdc-1da3dcc0f090 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:59.199141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7380bbfa-d2ae-40bc-acdc-1da3dcc0f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:59.246454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:59.267889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1182/2348] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:59.276032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb80b-1552-4eef-9d64-b7e18b00f21f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.276318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb80b-1552-4eef-9d64-b7e18b00f21f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.276593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb80b-1552-4eef-9d64-b7e18b00f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.296920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b36bb80b-1552-4eef-9d64-b7e18b00f21f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:59.298166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b36bb80b-1552-4eef-9d64-b7e18b00f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:59.307552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1167/2349] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:59.311601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380bbfa-d2ae-40bc-acdc-1da3dcc0f090 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.322833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380bbfa-d2ae-40bc-acdc-1da3dcc0f090 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.327369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.327979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.328223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.328499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.329173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:59.329510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.331127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.343597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1183/2350] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:59.351110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb80b-1552-4eef-9d64-b7e18b00f21f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.368417 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb80b-1552-4eef-9d64-b7e18b00f21f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.373884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.374513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.374793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.375065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.375705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.377706 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.412439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1168/2351] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:59 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:59.416595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.426644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74950-b692-45a4-a2ec-10ef197ad946 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.494342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.494936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.495272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.495475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.496210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.498120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.555109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1184/2352] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:59 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:59.557040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.569797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45e530-bdad-4226-a75f-3f0e513463f4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.575649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.576344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.577130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.577130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.577854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.579532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.608099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.616405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1169/2353] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:59.631725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c95551-3c5f-45d5-b2f3-79e0dc9613d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.643248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.644176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.644492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.644835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.645880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.648334 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.662919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1185/2354] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:59.667145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.681687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.682718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96103760-a3a8-4d69-8249-ec2bb538b710 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.684329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:59.698753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfe92d-37fb-4286-91fd-70b5e84390f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.699448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe92d-37fb-4286-91fd-70b5e84390f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.699793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe92d-37fb-4286-91fd-70b5e84390f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.700130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe92d-37fb-4286-91fd-70b5e84390f8 admin admin] PATH_INFO: `/v3/projects/7e8b4539a9e9491d8797b286a9782d6a/users/2fc50d836012416c8b646ec76fa91828/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.702738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785bf79-a58a-413a-ad97-3f1bcb604221 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.713986 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:59.714640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.714965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.715232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] PATH_INFO: `/v3/users/034db150f17047fe8debd09f8820bc5b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.716347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=034db150f17047fe8debd09f8820bc5b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.718162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfe92d-37fb-4286-91fd-70b5e84390f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8b4539a9e9491d8797b286a9782d6a, user_id=2fc50d836012416c8b646ec76fa91828, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:59.718404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.720964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfe92d-37fb-4286-91fd-70b5e84390f8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:59.747930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1170/2355] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:59 2022] PUT /identity/v3/projects/7e8b4539a9e9491d8797b286a9782d6a/users/2fc50d836012416c8b646ec76fa91828/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:59.752995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.753629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.753890 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.780722 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:59.782087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:59.791112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034db150f17047fe8debd09f8820bc5b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.793682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:59.802765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034db150f17047fe8debd09f8820bc5b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.817204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034db150f17047fe8debd09f8820bc5b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.818079 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034db150f17047fe8debd09f8820bc5b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.818829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8518eae2-83af-42df-84af-c510a4afff99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034db150f17047fe8debd09f8820bc5b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:59.837919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1186/2356] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:59 2022] DELETE /identity/v3/users/034db150f17047fe8debd09f8820bc5b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:59.841430 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628841-a5a6-4473-9169-acfad5491210 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:59.842349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628841-a5a6-4473-9169-acfad5491210 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:59.842639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628841-a5a6-4473-9169-acfad5491210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:59.859843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1171/2357] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:34:59.865687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-03628841-a5a6-4473-9169-acfad5491210 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:59.867556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03628841-a5a6-4473-9169-acfad5491210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:59.873143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:59.876445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:59.894614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:59.959954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f34f62-86f1-46f3-9686-d00998dd2d56 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:59.967389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1187/2358] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:59.977093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03628841-a5a6-4473-9169-acfad5491210 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:00.030179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:00.030916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:00.032760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:00.032760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:00.047332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:00.047563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03628841-a5a6-4473-9169-acfad5491210 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:00.049605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:00.054434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:00.055096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:00.055458 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:00.055704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:00.062303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1172/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:00.067867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:00.069714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:00.081214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1188/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:00.499287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:00.500920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:00.519105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501733-efda-44fd-a322-bbf17a4b4e58 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:00.533336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:00.534047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:00.534326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:00.534627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] PATH_INFO: `/v3/projects/64f028cfc9ac4cc0805809e63532fe0e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:00.535860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f028cfc9ac4cc0805809e63532fe0e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:00.537941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:00.651874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f028cfc9ac4cc0805809e63532fe0e', 'request_id': 'req-2a977d6e-4dab-458b-b452-647e6907aa23'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:00.667418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f028cfc9ac4cc0805809e63532fe0e', 'request_id': 'req-2a977d6e-4dab-458b-b452-647e6907aa23'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:00.697447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f028cfc9ac4cc0805809e63532fe0e', 'request_id': 'req-2a977d6e-4dab-458b-b452-647e6907aa23'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:00.711778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:00.726389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] The token cache is being invalidate because project 64f028cfc9ac4cc0805809e63532fe0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:35:00.726938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:00.728438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:00.735811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1173/2361] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:35:00 2022] DELETE /identity/v3/projects/64f028cfc9ac4cc0805809e63532fe0e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:00.738156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:00.769521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ef3db-7716-4b64-a375-186d9139c4ec service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:01.004798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:01.005467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:01.005793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:01.006165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] PATH_INFO: `/v3/users/0f4c5132b3f040d398954068ac33b036` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:01.007527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4c5132b3f040d398954068ac33b036)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:01.010125 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:01.130206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4c5132b3f040d398954068ac33b036'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.163398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4c5132b3f040d398954068ac33b036'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.199472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4c5132b3f040d398954068ac33b036'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.200564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4c5132b3f040d398954068ac33b036'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.202540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4c5132b3f040d398954068ac33b036'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.205097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:01.244886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1189/2362] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:35:00 2022] DELETE /identity/v3/users/0f4c5132b3f040d398954068ac33b036 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:01.776356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:01.778949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:01.794843 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977d6e-4dab-458b-b452-647e6907aa23 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:01.877233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:01.878549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:01.878902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:01.879248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] PATH_INFO: `/v3/projects/58f3ce6ae414470c979703eb760a4ab1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:01.880456 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f3ce6ae414470c979703eb760a4ab1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:01.883377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:01.939757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f3ce6ae414470c979703eb760a4ab1', 'request_id': 'req-8d810d9b-2abb-4784-93dd-1ce732a11d6a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.947204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f3ce6ae414470c979703eb760a4ab1', 'request_id': 'req-8d810d9b-2abb-4784-93dd-1ce732a11d6a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.959137 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f3ce6ae414470c979703eb760a4ab1', 'request_id': 'req-8d810d9b-2abb-4784-93dd-1ce732a11d6a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.977130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] The token cache is being invalidate because project 58f3ce6ae414470c979703eb760a4ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:35:01.977130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.977939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:01.981471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1174/2363] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:35:01 2022] DELETE /identity/v3/projects/58f3ce6ae414470c979703eb760a4ab1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:01.983706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:01.985578 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:01.999454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363b74-4430-41cb-b03a-b40e72554a72 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:02.074283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:02.074973 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:02.075350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:02.075660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] PATH_INFO: `/v3/users/333e80318e6d4387b28e437123770097` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:02.078225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=333e80318e6d4387b28e437123770097)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:02.080484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:02.167695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333e80318e6d4387b28e437123770097'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:02.181201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333e80318e6d4387b28e437123770097'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:02.199568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333e80318e6d4387b28e437123770097'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:02.200336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333e80318e6d4387b28e437123770097'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:02.200948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9981ef21-8c4f-4953-b735-5f44c0739fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333e80318e6d4387b28e437123770097'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:02.217425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1190/2364] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:35:01 2022] DELETE /identity/v3/users/333e80318e6d4387b28e437123770097 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:02.705189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:02.720139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:02.770373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810d9b-2abb-4784-93dd-1ce732a11d6a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:02.921900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:02.923655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:02.924131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:02.924536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] PATH_INFO: `/v3/projects/827d4591f34f48968c05b15c00bad73f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:02.932170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827d4591f34f48968c05b15c00bad73f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:02.944672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:03.025922 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:03.045660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827d4591f34f48968c05b15c00bad73f', 'request_id': 'req-6a581566-6e92-4cfa-94b7-9d78f29df2a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:03.060965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827d4591f34f48968c05b15c00bad73f', 'request_id': 'req-6a581566-6e92-4cfa-94b7-9d78f29df2a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:03.082971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827d4591f34f48968c05b15c00bad73f', 'request_id': 'req-6a581566-6e92-4cfa-94b7-9d78f29df2a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:03.101446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] The token cache is being invalidate because project 827d4591f34f48968c05b15c00bad73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:35:03.101743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:03.102507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6a581566-6e92-4cfa-94b7-9d78f29df2a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:03.108149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1175/2365] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:35:02 2022] DELETE /identity/v3/projects/827d4591f34f48968c05b15c00bad73f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:04.553104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:04.554092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:04.554652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:04.582299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] MFA Rules not processed for user `0aa7040691be4940a0059eac5d638109`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:04.584011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:04.663845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1191/2366] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:07.927039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f6325-2103-44fe-91ca-8188f4cd3850 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:07.927580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f6325-2103-44fe-91ca-8188f4cd3850 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:07.927580 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f6325-2103-44fe-91ca-8188f4cd3850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:07.962241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2d1f6325-2103-44fe-91ca-8188f4cd3850 None None] MFA Rules not processed for user `2fc50d836012416c8b646ec76fa91828`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:07.963482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2d1f6325-2103-44fe-91ca-8188f4cd3850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:08.063227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1176/2367] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:08.064835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:08.066755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:08.083397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:08.161645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b181-e06c-4c83-b701-e27b36f3294f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:08.168864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:08.169678 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:08.169961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:08.170237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:08.170880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:08.172824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:08.212377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1192/2368] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:35:08 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:35:08.215070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f6325-2103-44fe-91ca-8188f4cd3850 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:08.229160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f6325-2103-44fe-91ca-8188f4cd3850 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:08.298080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:08.298738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:08.299018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:08.299288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:08.299937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:08.301950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:08.329618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1177/2369] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:35:08 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:35:08.334084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:08.345349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3c8f-10ef-44be-897d-d4ccc5169c47 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:08.350147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:08.351678 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:08.352023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:08.352369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:08.353340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:08.355766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:08.371735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1193/2370] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:35:08.376460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:08.389281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3835c-1a1b-4e27-9651-a02ad7196bee admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:08.394032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:08.394709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:08.394990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:08.395265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] PATH_INFO: `/v3/projects/a22ccb3371d64e27bdc68a86526d8700/users/ec8670baae0545eeb481da83c481f929/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:08.412264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22ccb3371d64e27bdc68a86526d8700, user_id=ec8670baae0545eeb481da83c481f929, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:08.415159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:08.429800 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1178/2371] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:35:08 2022] PUT /identity/v3/projects/a22ccb3371d64e27bdc68a86526d8700/users/ec8670baae0545eeb481da83c481f929/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:35:08.434024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:08.445228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9851b6-2ab4-4cba-92a1-84bb3e3d6823 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:08.503495 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:08.504120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:08.504402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:08.504674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:08.505323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:08.507068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:08.517619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1194/2372] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:35:08.522130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:08.533767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f6b2f-8c85-4fcd-806b-ee16fbe9e85b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:08.538891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759589c8-bce3-4b85-a828-f639d223157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:08.539567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759589c8-bce3-4b85-a828-f639d223157c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:08.539844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759589c8-bce3-4b85-a828-f639d223157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:08.540119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759589c8-bce3-4b85-a828-f639d223157c admin admin] PATH_INFO: `/v3/projects/a22ccb3371d64e27bdc68a86526d8700/users/ec8670baae0545eeb481da83c481f929/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:08.542316 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759589c8-bce3-4b85-a828-f639d223157c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22ccb3371d64e27bdc68a86526d8700, user_id=ec8670baae0545eeb481da83c481f929, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:08.545047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759589c8-bce3-4b85-a828-f639d223157c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:08.551326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:08.558103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1179/2373] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:35:08 2022] PUT /identity/v3/projects/a22ccb3371d64e27bdc68a86526d8700/users/ec8670baae0545eeb481da83c481f929/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:11.666999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:11.668916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:11.689851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23ade7-aa13-46aa-80bd-c288728630e5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:11.786074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:11.786821 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:11.787166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:11.787504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] PATH_INFO: `/v3/users/842b63f13b8f4ed08db32e83b998e84a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:11.788829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] RBAC: Authorizing `identity:delete_user(user_id=842b63f13b8f4ed08db32e83b998e84a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:11.791217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:11.847983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:11.883142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842b63f13b8f4ed08db32e83b998e84a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:11.913601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842b63f13b8f4ed08db32e83b998e84a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:11.931289 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842b63f13b8f4ed08db32e83b998e84a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:11.932764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842b63f13b8f4ed08db32e83b998e84a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:11.934540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842b63f13b8f4ed08db32e83b998e84a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:11.953928 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1195/2374] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:35:11 2022] DELETE /identity/v3/users/842b63f13b8f4ed08db32e83b998e84a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:11.959632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:11.960097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:11.960409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:12.003540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:12.006632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:12.160533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1180/2375] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:12.170279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:12.171851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:12.294479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5acd5d-b696-4cbb-9edb-65f5865d078d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:12.300616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc593-8390-4e24-af61-a5f497132e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:12.301517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc593-8390-4e24-af61-a5f497132e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:12.301989 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc593-8390-4e24-af61-a5f497132e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:12.302355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc593-8390-4e24-af61-a5f497132e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:12.326345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fc593-8390-4e24-af61-a5f497132e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:12.328159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fc593-8390-4e24-af61-a5f497132e36 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:12.351482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1196/2376] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:13.598139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:13.601106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:13.622011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a28e7-b697-485f-9a74-12547e72b4d6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:13.642288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:13.642968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:13.643247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:13.643695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] PATH_INFO: `/v3/projects/c327c5a2bbd94c758fd6c46433ce02f7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:13.644937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c327c5a2bbd94c758fd6c46433ce02f7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:13.646937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:13.742501 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c327c5a2bbd94c758fd6c46433ce02f7', 'request_id': 'req-337ce928-3b87-4159-9dce-8aba0726ffe1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:13.753313 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c327c5a2bbd94c758fd6c46433ce02f7', 'request_id': 'req-337ce928-3b87-4159-9dce-8aba0726ffe1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:13.778028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c327c5a2bbd94c758fd6c46433ce02f7', 'request_id': 'req-337ce928-3b87-4159-9dce-8aba0726ffe1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:13.800986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] The token cache is being invalidate because project c327c5a2bbd94c758fd6c46433ce02f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:35:13.801587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:13.802814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-337ce928-3b87-4159-9dce-8aba0726ffe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:13.805255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1181/2377] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:35:13 2022] DELETE /identity/v3/projects/c327c5a2bbd94c758fd6c46433ce02f7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:13.810837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1cbf-28c3-4b6a-95b4-7c220850668b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:13.811343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1cbf-28c3-4b6a-95b4-7c220850668b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:13.811434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1cbf-28c3-4b6a-95b4-7c220850668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:13.844393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ecfa1cbf-28c3-4b6a-95b4-7c220850668b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:13.845693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ecfa1cbf-28c3-4b6a-95b4-7c220850668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:13.973464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1197/2378] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:35:13.983260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3cd53-e0be-4230-8cf9-7be011888f1e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:13.983539 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3cd53-e0be-4230-8cf9-7be011888f1e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:13.983815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3cd53-e0be-4230-8cf9-7be011888f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.010044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5dc3cd53-e0be-4230-8cf9-7be011888f1e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:14.011272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5dc3cd53-e0be-4230-8cf9-7be011888f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:14.024624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1182/2379] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:14.029016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1cbf-28c3-4b6a-95b4-7c220850668b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:14.048955 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1cbf-28c3-4b6a-95b4-7c220850668b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:14.059077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:14.060024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.060658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.061091 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.062409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:35:14.062943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:14.065221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:14.095859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1198/2380] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:35:14.102557 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3cd53-e0be-4230-8cf9-7be011888f1e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:14.117728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3cd53-e0be-4230-8cf9-7be011888f1e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:14.123161 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:14.124036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.124416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.124693 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.125489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:14.127703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:14.177858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1183/2381] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:35:14 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:35:14.180016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:14.193291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b79ca-8b89-4fbd-9c45-c15a55ac79ed admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:14.254319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:14.312039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:14.312623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.312877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.313139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.313857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:14.315915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:14.354397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:14.362763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1199/2382] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:35:14 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:35:14.368616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3039bb-f7dc-4405-8407-b163bcf0d976 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:14.374657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:14.375552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.375993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.376332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.377348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:14.379521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:14.396935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1184/2383] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:35:14.398917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:14.410599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6301-d938-4100-828d-7acf6d3b7bf1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:14.417155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d22d02-4107-4483-b91d-2610251ca58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:14.418184 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d22d02-4107-4483-b91d-2610251ca58a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.418631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d22d02-4107-4483-b91d-2610251ca58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.419064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d22d02-4107-4483-b91d-2610251ca58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.419980 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d22d02-4107-4483-b91d-2610251ca58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:14.422231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d22d02-4107-4483-b91d-2610251ca58a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:14.440555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1200/2384] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:35:14.442368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:14.455106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae3d31-8aa7-4d5b-9910-08b390585186 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:14.464124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a8fac-fa56-4949-b899-9f5bc1e3411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:14.464932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8fac-fa56-4949-b899-9f5bc1e3411a admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.465274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8fac-fa56-4949-b899-9f5bc1e3411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.465647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8fac-fa56-4949-b899-9f5bc1e3411a admin admin] PATH_INFO: `/v3/projects/9f50bcbb80004ad0b6cedca0266a05d2/users/4363d8cb81e8461eadc552ff3adec405/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.491641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a8fac-fa56-4949-b899-9f5bc1e3411a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f50bcbb80004ad0b6cedca0266a05d2, user_id=4363d8cb81e8461eadc552ff3adec405, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:14.495128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a8fac-fa56-4949-b899-9f5bc1e3411a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:14.530686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.531270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.531626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.531732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1185/2385] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:35:14 2022] PUT /identity/v3/projects/9f50bcbb80004ad0b6cedca0266a05d2/users/4363d8cb81e8461eadc552ff3adec405/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:14.545897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6384f-feb8-4978-971a-d7fae975dbbe None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.546293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6384f-feb8-4978-971a-d7fae975dbbe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.546648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6384f-feb8-4978-971a-d7fae975dbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.570743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] MFA Rules not processed for user `f36a028693b0421896b62552eeb9af61`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:14.572090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:14.603158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a8a6384f-feb8-4978-971a-d7fae975dbbe None None] MFA Rules not processed for user `4363d8cb81e8461eadc552ff3adec405`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:14.605172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a8a6384f-feb8-4978-971a-d7fae975dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:14.612070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:14.696328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1201/2386] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:14.713904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1186/2387] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:35:14.731207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:14.733201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:14.890044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e1902-d588-4ec5-b2b2-18ac40f69bd4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:14.895824 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:14.896781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:14.897512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:14.898254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:14.915278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:14.917108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:14.927912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1202/2388] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:16.551743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c98a1c-a36b-4cce-a9b5-d28653e00787 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:16.552175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c98a1c-a36b-4cce-a9b5-d28653e00787 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:16.552283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c98a1c-a36b-4cce-a9b5-d28653e00787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:16.586007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-02c98a1c-a36b-4cce-a9b5-d28653e00787 None None] MFA Rules not processed for user `ec8670baae0545eeb481da83c481f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:16.587746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-02c98a1c-a36b-4cce-a9b5-d28653e00787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:16.681227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1187/2389] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:16.695326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:16.696852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:16.809115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80579fa4-c3f3-4d35-af54-6cbde0e6912d service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:16.820561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:16.821264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:16.821570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:16.821836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:16.825229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:16.865109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:16.933616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:16.937643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:16.952684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1203/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:35:17.296525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c865c-a460-43f8-9f7b-0e5d432b7733 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:17.296815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c865c-a460-43f8-9f7b-0e5d432b7733 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:17.297089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c865c-a460-43f8-9f7b-0e5d432b7733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:17.330866 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4c8c865c-a460-43f8-9f7b-0e5d432b7733 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:17.333189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c8c865c-a460-43f8-9f7b-0e5d432b7733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:17.438728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1188/2391] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:35:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:35:17.487207 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:17.488793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:17.569759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf582f-8cb0-4419-a917-623c2e490ae9 service glance] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:17.574939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ce414-7e00-41f8-8087-6664e31e03b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:17.575590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ce414-7e00-41f8-8087-6664e31e03b5 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:17.575869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ce414-7e00-41f8-8087-6664e31e03b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:17.576170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ce414-7e00-41f8-8087-6664e31e03b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:17.584618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ce414-7e00-41f8-8087-6664e31e03b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:17.586945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ce414-7e00-41f8-8087-6664e31e03b5 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:17.600061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1204/2392] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:35:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:17.787508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c865c-a460-43f8-9f7b-0e5d432b7733 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:17.855061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:17.889039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c865c-a460-43f8-9f7b-0e5d432b7733 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:17.901490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:17.902396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:17.902829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:17.903276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] PATH_INFO: `/v3/users/4363d8cb81e8461eadc552ff3adec405` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:17.904589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4363d8cb81e8461eadc552ff3adec405)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:17.906761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:17.983365 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4363d8cb81e8461eadc552ff3adec405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:17.993649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4363d8cb81e8461eadc552ff3adec405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:17.994731 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4363d8cb81e8461eadc552ff3adec405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:18.025042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4363d8cb81e8461eadc552ff3adec405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:18.029658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4363d8cb81e8461eadc552ff3adec405'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:18.087819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1189/2393] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:35:17 2022] DELETE /identity/v3/users/4363d8cb81e8461eadc552ff3adec405 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:18.096083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:18.096640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:18.096640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:18.130616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:18.132428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:18.211619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1205/2394] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:18.220963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:18.222515 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:18.315486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1e6f-a44a-4911-8953-d1aebc994759 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:18.322151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18312e05-6fcd-4f52-abf9-a599312838af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:18.322927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18312e05-6fcd-4f52-abf9-a599312838af service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:18.323934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18312e05-6fcd-4f52-abf9-a599312838af service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:18.323934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18312e05-6fcd-4f52-abf9-a599312838af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:18.358321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18312e05-6fcd-4f52-abf9-a599312838af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:18.359999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18312e05-6fcd-4f52-abf9-a599312838af service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:18.390986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1190/2395] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:19.172473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:19.174545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:19.215525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf163a4-af3c-4024-9bfa-73254e02d9c1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:19.229719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:19.230698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.231317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.233884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] PATH_INFO: `/v3/projects/9f50bcbb80004ad0b6cedca0266a05d2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.235873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f50bcbb80004ad0b6cedca0266a05d2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:19.245815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:19.340106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:19.352473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f50bcbb80004ad0b6cedca0266a05d2', 'request_id': 'req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:19.360058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f50bcbb80004ad0b6cedca0266a05d2', 'request_id': 'req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:19.372604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f50bcbb80004ad0b6cedca0266a05d2', 'request_id': 'req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:19.389462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] The token cache is being invalidate because project 9f50bcbb80004ad0b6cedca0266a05d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:35:19.389938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:19.390740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a1f8bd3e-7f65-4b04-aecc-9fa8039c95e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:19.395790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1206/2396] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:35:19 2022] DELETE /identity/v3/projects/9f50bcbb80004ad0b6cedca0266a05d2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:19.397600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193efb2c-9a18-489a-9eee-3dbd00b90128 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.398129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193efb2c-9a18-489a-9eee-3dbd00b90128 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.398129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193efb2c-9a18-489a-9eee-3dbd00b90128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.437268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-193efb2c-9a18-489a-9eee-3dbd00b90128 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:19.438565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-193efb2c-9a18-489a-9eee-3dbd00b90128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:19.557897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:19.573101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1191/2397] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:19.581484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a2c6-3f02-461c-a4dd-4b7e7a88563f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.581914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a2c6-3f02-461c-a4dd-4b7e7a88563f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.582306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a2c6-3f02-461c-a4dd-4b7e7a88563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.614925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c5c4a2c6-3f02-461c-a4dd-4b7e7a88563f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:19.618299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c5c4a2c6-3f02-461c-a4dd-4b7e7a88563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:19.636706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1207/2398] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:19.640878 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193efb2c-9a18-489a-9eee-3dbd00b90128 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:19.655826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193efb2c-9a18-489a-9eee-3dbd00b90128 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:19.670351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:19.670351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.670351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.670351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.670840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:35:19.670840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:19.670840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:19.688571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1192/2399] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:35:19.701417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4a2c6-3f02-461c-a4dd-4b7e7a88563f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:19.712610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4a2c6-3f02-461c-a4dd-4b7e7a88563f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:19.723301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:19.723959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.724328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.724659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.725631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:19.727767 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:19.765601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1208/2400] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:35:19 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:35:19.767132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:19.785062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b9074-af18-4d0b-9eef-0d3a50cad5f6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:19.853840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:19.854131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.854238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.855156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.856116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:19.858647 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:19.894582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1193/2401] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:35:19 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:35:19.896507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:19.909706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7aee-cb7b-466a-a848-911f24ec1bc6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:19.916655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:19.917324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.917324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.917714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.918686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:19.920173 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:19.940104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:19.940339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1209/2402] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:35:19.953277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89908564-5d6e-4a84-a522-520d1442209f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:19.957518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33248a8d-efe3-4bed-b740-d9a41ab00e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:19.958319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33248a8d-efe3-4bed-b740-d9a41ab00e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:19.959205 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33248a8d-efe3-4bed-b740-d9a41ab00e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:19.959669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33248a8d-efe3-4bed-b740-d9a41ab00e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:19.960450 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33248a8d-efe3-4bed-b740-d9a41ab00e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:19.973448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33248a8d-efe3-4bed-b740-d9a41ab00e98 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:19.984240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:19.990839 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1194/2403] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:35:19.998866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998a08-8b26-43d1-b1fd-175e6fc276bf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:20.025757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:20.026460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:20.026737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:20.027008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] PATH_INFO: `/v3/projects/d965951707b44c25b28f70f6eef851a4/users/7fd0f09c6e8f4d29b6c112f091b13385/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:20.060933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d965951707b44c25b28f70f6eef851a4, user_id=7fd0f09c6e8f4d29b6c112f091b13385, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:20.063775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:20.106479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1210/2404] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:35:19 2022] PUT /identity/v3/projects/d965951707b44c25b28f70f6eef851a4/users/7fd0f09c6e8f4d29b6c112f091b13385/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:35:20.118292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35c0b4-23eb-4dae-b662-5cf9e0d1b3b1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:20.118649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35c0b4-23eb-4dae-b662-5cf9e0d1b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:20.118865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35c0b4-23eb-4dae-b662-5cf9e0d1b3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:20.158195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1f35c0b4-23eb-4dae-b662-5cf9e0d1b3b1 None None] MFA Rules not processed for user `7fd0f09c6e8f4d29b6c112f091b13385`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:20.159561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1f35c0b4-23eb-4dae-b662-5cf9e0d1b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:20.275648 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1195/2405] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:20.292427 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:20.294974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:20.422518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35d557-c659-48ab-8243-9835f862295d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:20.426406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e248cf-3347-42ae-ad92-535ccb7fc5f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:20.427149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e248cf-3347-42ae-ad92-535ccb7fc5f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:20.427303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e248cf-3347-42ae-ad92-535ccb7fc5f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:20.427582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e248cf-3347-42ae-ad92-535ccb7fc5f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:20.441667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e248cf-3347-42ae-ad92-535ccb7fc5f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:20.444061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e248cf-3347-42ae-ad92-535ccb7fc5f2 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:20.469584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1211/2406] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:25.461200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:25.461824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:25.461824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:25.487787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] MFA Rules not processed for user `d91359eb2ecb4b7391f579732a596602`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:25.489334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:25.628288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:25.635754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1196/2407] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:26.054132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6141c9-3b05-42bd-a641-12344e45f6ca None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:26.055069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6141c9-3b05-42bd-a641-12344e45f6ca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:26.061251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6141c9-3b05-42bd-a641-12344e45f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:26.094812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ad6141c9-3b05-42bd-a641-12344e45f6ca None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:26.096515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ad6141c9-3b05-42bd-a641-12344e45f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:26.235291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1212/2408] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:26.248171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:26.249697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:26.363433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4192-d75a-427a-a68f-96fdbc7fb56c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:26.369945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:26.370640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:26.370920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:26.371917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:26.386714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:26.396621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:26.428696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1197/2409] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:27.508958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a594a25-480a-4add-999d-0c782d449fbd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:27.509880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a594a25-480a-4add-999d-0c782d449fbd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:27.511003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a594a25-480a-4add-999d-0c782d449fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:27.534881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0a594a25-480a-4add-999d-0c782d449fbd None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:27.536126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0a594a25-480a-4add-999d-0c782d449fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:27.543772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1213/2410] 10.222.0.25 () {58 vars in 967 bytes} [Mon Aug 8 02:35:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:27.560685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:27.572305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f67fc1-2a6d-4353-bd9c-e57a0aa4458c service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:27.579398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:27.580992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:27.581508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:27.581957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:27.594474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:27.596372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:27.607574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1198/2411] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:35:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:28.142889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa022-de9a-42bd-baf4-a74a8a6e3f74 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:28.143245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa022-de9a-42bd-baf4-a74a8a6e3f74 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:28.143580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa022-de9a-42bd-baf4-a74a8a6e3f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:28.158339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:28.172190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-976fa022-de9a-42bd-baf4-a74a8a6e3f74 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:28.173881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-976fa022-de9a-42bd-baf4-a74a8a6e3f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:28.192042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1214/2412] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:35:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:28.222237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:28.244645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913fd39-b9ca-4bad-a7dc-be3e294682d2 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:28.258147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:28.258938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:28.259319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:28.261797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:28.278257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:28.280534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:28.293894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1199/2413] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:35:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:28.852475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:28.853096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:28.853096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:28.874092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:28.875318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:28.885234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1215/2414] 10.222.0.25 () {58 vars in 967 bytes} [Mon Aug 8 02:35:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:28.904014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:28.920377 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a503bb-d12b-4896-991b-13d893273865 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:28.934160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bdc6b-0e69-4da2-8134-1f87db18038a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:28.935534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bdc6b-0e69-4da2-8134-1f87db18038a service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:28.936072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bdc6b-0e69-4da2-8134-1f87db18038a service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:28.936578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bdc6b-0e69-4da2-8134-1f87db18038a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:28.950046 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bdc6b-0e69-4da2-8134-1f87db18038a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:28.952150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bdc6b-0e69-4da2-8134-1f87db18038a service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:28.961947 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1200/2415] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:35:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:32.170191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:32.172970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:32.327109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4183b-32cd-46d9-bf6e-52d1b704d398 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:32.343886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:32.344737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:32.345152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:32.345631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] PATH_INFO: `/v3/users/45d1bd77a13a4bf7b0350816763b62c1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:32.346931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d1bd77a13a4bf7b0350816763b62c1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:32.349033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:32.450609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d1bd77a13a4bf7b0350816763b62c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:32.467582 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d1bd77a13a4bf7b0350816763b62c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:32.489898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d1bd77a13a4bf7b0350816763b62c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:32.490853 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d1bd77a13a4bf7b0350816763b62c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:32.497171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d1bd77a13a4bf7b0350816763b62c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:32.529702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1216/2416] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:35:32 2022] DELETE /identity/v3/users/45d1bd77a13a4bf7b0350816763b62c1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:35:32.534026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:32.534867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:32.535296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:32.570859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:32.573047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:32.714913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1201/2417] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:35:32.730067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:32.731788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:32.808115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab55c1-ed35-42c2-bf0d-f3b98d58fb75 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:32.815377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:32.816554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:32.817293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:32.817671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:32.832015 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:32.833621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:32.846476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1217/2418] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:33.514111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:33.516767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:33.532100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:33.534366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:33.562746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec8075-1cf9-4930-b64b-3f8812cbe9b6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:33.564251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4b273-690c-4550-9a2f-f8016a6ad9c6 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:33.568691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:33.570366 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:33.570657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:33.570793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:33.570965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] PATH_INFO: `/v3/users/7fd0f09c6e8f4d29b6c112f091b13385` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:33.571314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:33.571595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:33.571870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] PATH_INFO: `/v3/projects/12a9b2e89a1f438da5c0610494cb9adf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:33.572821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd0f09c6e8f4d29b6c112f091b13385)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:33.573057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a9b2e89a1f438da5c0610494cb9adf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:33.575023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:33.575181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:33.585807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:33.682659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:33.686532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd0f09c6e8f4d29b6c112f091b13385'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.687202 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a9b2e89a1f438da5c0610494cb9adf', 'request_id': 'req-4450d64a-8da2-4c24-ab37-e0168007ac5d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.701659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a9b2e89a1f438da5c0610494cb9adf', 'request_id': 'req-4450d64a-8da2-4c24-ab37-e0168007ac5d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.711566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd0f09c6e8f4d29b6c112f091b13385'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.713219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd0f09c6e8f4d29b6c112f091b13385'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.729636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a9b2e89a1f438da5c0610494cb9adf', 'request_id': 'req-4450d64a-8da2-4c24-ab37-e0168007ac5d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.747115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd0f09c6e8f4d29b6c112f091b13385'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.749177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3bc42281-2697-4d72-abc8-4b6cb2fa9dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd0f09c6e8f4d29b6c112f091b13385'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.761167 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] The token cache is being invalidate because project 12a9b2e89a1f438da5c0610494cb9adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:35:33.761778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.764585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4450d64a-8da2-4c24-ab37-e0168007ac5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:33.772130 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1218/2419] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:35:33 2022] DELETE /identity/v3/projects/12a9b2e89a1f438da5c0610494cb9adf => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:35:33.777503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eea9d-d6ae-411c-9620-b1ddde3f8a6d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:33.778107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eea9d-d6ae-411c-9620-b1ddde3f8a6d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:33.778395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eea9d-d6ae-411c-9620-b1ddde3f8a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:33.789767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1202/2420] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:35:33 2022] DELETE /identity/v3/users/7fd0f09c6e8f4d29b6c112f091b13385 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:33.796004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:33.796335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:33.801326 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:33.853872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9d5eea9d-d6ae-411c-9620-b1ddde3f8a6d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:33.855405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9d5eea9d-d6ae-411c-9620-b1ddde3f8a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:33.856895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:33.858221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:33.996490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1219/2421] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:34.011185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36386-8eb1-4dcf-9ec2-1543f13595df None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.011584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36386-8eb1-4dcf-9ec2-1543f13595df None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.012100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36386-8eb1-4dcf-9ec2-1543f13595df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.047686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1203/2422] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:34.063560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.066635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:34.072592 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-05c36386-8eb1-4dcf-9ec2-1543f13595df None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:34.074780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05c36386-8eb1-4dcf-9ec2-1543f13595df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:34.098340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1220/2423] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:34.104799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36386-8eb1-4dcf-9ec2-1543f13595df None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.136011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36386-8eb1-4dcf-9ec2-1543f13595df None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.146108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.146888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.147267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.147640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.148401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:35:34.150072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.156040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.173900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1221/2424] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:35:34.179189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.198267 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281edbab-a86d-4b87-b22e-2238d9796e16 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.199646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af7e79-19af-4d33-884e-43af940f0d87 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.206549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.207531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.207902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.208268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.212215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.213233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.213703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.214132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.214929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.218699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.221218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.225847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.239266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1204/2425] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:34.318640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.327473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1222/2426] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:35:34 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:35:34.333892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ab13-569f-4f7f-b544-095e38ee22b6 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.427072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.428124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.428544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.428968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.429792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.432247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.449152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:34.477182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.484691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1205/2427] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:35:34 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:35:34.490958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52754-f950-41d4-b622-061fcad1fd66 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.496444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.497395 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.497912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.498398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.499388 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.501241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.517417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1223/2428] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:35:34.519301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.531534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be109b1-9dec-4d70-95d3-b4d9cf832269 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.543286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bafd74-fea8-4c87-8004-76efd156c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.543932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bafd74-fea8-4c87-8004-76efd156c00c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.544204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bafd74-fea8-4c87-8004-76efd156c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.544467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bafd74-fea8-4c87-8004-76efd156c00c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.545131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bafd74-fea8-4c87-8004-76efd156c00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.546877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bafd74-fea8-4c87-8004-76efd156c00c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.564923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1206/2429] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:35:34.568875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.581112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd846b-2e34-451e-a62e-a73f68de2866 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.588676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.589664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.590389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.590966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] PATH_INFO: `/v3/projects/c1a617a502894490898d9d5054ece742/users/9081aa7047ae4ef0b1df7c7918ec1ac0/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.643019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a617a502894490898d9d5054ece742, user_id=9081aa7047ae4ef0b1df7c7918ec1ac0, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.647525 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.664088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1224/2430] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:35:34 2022] PUT /identity/v3/projects/c1a617a502894490898d9d5054ece742/users/9081aa7047ae4ef0b1df7c7918ec1ac0/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:35:34.669016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bc94b-e6c5-4493-8de6-5694be73533e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.669305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bc94b-e6c5-4493-8de6-5694be73533e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.669615 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bc94b-e6c5-4493-8de6-5694be73533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.675789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.689630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:34.694781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a33bc94b-e6c5-4493-8de6-5694be73533e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:34.695982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a33bc94b-e6c5-4493-8de6-5694be73533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:34.727774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:34.776829 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1207/2431] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:34.778428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5987d5-af37-44c0-b5b6-e654899966d1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.778932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5987d5-af37-44c0-b5b6-e654899966d1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.779418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5987d5-af37-44c0-b5b6-e654899966d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.784237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4d6fb-9592-46c4-8c43-a52eb9eee1ef admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.789641 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.790628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.791083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.791426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] PATH_INFO: `/v3/projects/d965951707b44c25b28f70f6eef851a4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.793597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d965951707b44c25b28f70f6eef851a4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:34.795696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:34.808964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8e5987d5-af37-44c0-b5b6-e654899966d1 None None] MFA Rules not processed for user `2fc50d836012416c8b646ec76fa91828`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:34.811478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8e5987d5-af37-44c0-b5b6-e654899966d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:34.863052 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd965951707b44c25b28f70f6eef851a4', 'request_id': 'req-029ef1e4-4f11-49b9-a2e3-4854c55c0524'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:34.873833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd965951707b44c25b28f70f6eef851a4', 'request_id': 'req-029ef1e4-4f11-49b9-a2e3-4854c55c0524'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:34.886238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd965951707b44c25b28f70f6eef851a4', 'request_id': 'req-029ef1e4-4f11-49b9-a2e3-4854c55c0524'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:34.898617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] The token cache is being invalidate because project d965951707b44c25b28f70f6eef851a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:35:34.898929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:34.899709 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:35:34.901934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1208/2433] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:34.902115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1225/2433] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:35:34 2022] DELETE /identity/v3/projects/d965951707b44c25b28f70f6eef851a4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:35:34.903047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:34.904481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:34.985034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ef1e4-4f11-49b9-a2e3-4854c55c0524 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:34.989098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:34.989856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:34.990145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:34.990414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:34.992532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:35.072660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:35.074070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:35.080704 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:35.086355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1226/2434] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:35.883544 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81367c78-2837-44a5-ab4b-8b96c4b47886 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:35.884018 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81367c78-2837-44a5-ab4b-8b96c4b47886 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:35.887774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81367c78-2837-44a5-ab4b-8b96c4b47886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:35.922636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-81367c78-2837-44a5-ab4b-8b96c4b47886 None None] MFA Rules not processed for user `9081aa7047ae4ef0b1df7c7918ec1ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:35.924324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-81367c78-2837-44a5-ab4b-8b96c4b47886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:36.021696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1209/2435] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:36.033039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:36.034505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:36.123273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c86ad-9c65-49e7-a962-32b1d3054c5f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:36.128696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4675d-382d-4c35-a04c-96d5af55c4cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:36.129482 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4675d-382d-4c35-a04c-96d5af55c4cf service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:36.129812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4675d-382d-4c35-a04c-96d5af55c4cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:36.130131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4675d-382d-4c35-a04c-96d5af55c4cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:36.139011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4675d-382d-4c35-a04c-96d5af55c4cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:36.140615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4675d-382d-4c35-a04c-96d5af55c4cf service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:36.149833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1227/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:35:37.532803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:37.533330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:37.533330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:37.554033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] MFA Rules not processed for user `9081aa7047ae4ef0b1df7c7918ec1ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:37.555248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:37.566584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1210/2437] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:38.531143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916f639-d849-470d-8d90-3b98cae658de None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:38.531672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916f639-d849-470d-8d90-3b98cae658de None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:38.531891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916f639-d849-470d-8d90-3b98cae658de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:38.552473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6916f639-d849-470d-8d90-3b98cae658de None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:38.553842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6916f639-d849-470d-8d90-3b98cae658de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:38.621961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1228/2438] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:35:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:38.641494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:38.643120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:38.661856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:38.760174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f905fe-0617-4934-a29c-93b47cfbb78c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:38.766581 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:38.769899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:38.769899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:38.769899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:38.778777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:38.781952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:38.793336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1211/2439] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:48.612746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=51 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:48.789103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=26 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:52.037615 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:52.038293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:52.038293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:52.062205 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:35:52.063393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:35:52.072723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1229/2440] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:35:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:35:52.085216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:52.095844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ac51-d3e6-4c7b-ab8b-b54a0b818fed service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:52.102086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4798e1-d94c-4cf2-aaea-ae4b9e00ddeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:52.102765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4798e1-d94c-4cf2-aaea-ae4b9e00ddeb service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:52.103106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4798e1-d94c-4cf2-aaea-ae4b9e00ddeb service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:52.103401 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4798e1-d94c-4cf2-aaea-ae4b9e00ddeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:52.112732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4798e1-d94c-4cf2-aaea-ae4b9e00ddeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:52.118920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4798e1-d94c-4cf2-aaea-ae4b9e00ddeb service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:52.127609 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1212/2441] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:35:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:02.056460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:02.124176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:07.046176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:07.047943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:07.061547 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7ae25-6a94-4d76-8c31-8bbcc789d2bd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:07.070902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:07.071984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:07.072477 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:07.072815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:07.076025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:07.150935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:07.152390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:07.164600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1230/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:11.390891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:11.391470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:11.391470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:11.410526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:11.411739 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:11.419749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1213/2443] 10.222.0.25 () {58 vars in 967 bytes} [Mon Aug 8 02:36:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:11.432867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:11.444909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce966d-d41d-4639-9426-53a7e291e1a9 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:11.449938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:11.450558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:11.450838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:11.451109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:11.462281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:11.463936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:11.472940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1231/2444] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:36:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:13.604368 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:13.606605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:13.625628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44ccb3-d9b2-43b2-ad43-add6902ef536 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:13.630486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:13.631138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:13.631413 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:13.631669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] PATH_INFO: `/v3/users/f36a028693b0421896b62552eeb9af61` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:13.632831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36a028693b0421896b62552eeb9af61)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:13.634896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:13.689635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36a028693b0421896b62552eeb9af61'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:13.699550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36a028693b0421896b62552eeb9af61'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:13.700137 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36a028693b0421896b62552eeb9af61'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:13.712629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36a028693b0421896b62552eeb9af61'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:13.713249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4912059-479a-430c-8373-09715e43e8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36a028693b0421896b62552eeb9af61'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:13.725425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1214/2445] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:36:13 2022] DELETE /identity/v3/users/f36a028693b0421896b62552eeb9af61 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:36:13.905880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:13.922734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1edf58-1333-4f8c-833b-b6d623dd472d service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:13.988937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:13.989524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:13.989779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:13.990054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] PATH_INFO: `/v3/projects/75cbffcc57164d9689c6e98a7c343eee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:13.991209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cbffcc57164d9689c6e98a7c343eee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:13.993302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:14.046041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cbffcc57164d9689c6e98a7c343eee', 'request_id': 'req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:14.053671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cbffcc57164d9689c6e98a7c343eee', 'request_id': 'req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:14.067105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cbffcc57164d9689c6e98a7c343eee', 'request_id': 'req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:14.082596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] The token cache is being invalidate because project 75cbffcc57164d9689c6e98a7c343eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:36:14.082910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:14.083579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:36:14.085949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1232/2446] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:36:13 2022] DELETE /identity/v3/projects/75cbffcc57164d9689c6e98a7c343eee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:36:23.722567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:24.079274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:27.789518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06e39-3d11-4d71-bc72-7e6360845191 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:27.790072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06e39-3d11-4d71-bc72-7e6360845191 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:27.790072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06e39-3d11-4d71-bc72-7e6360845191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:27.811352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b6f06e39-3d11-4d71-bc72-7e6360845191 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:27.812568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b6f06e39-3d11-4d71-bc72-7e6360845191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:27.883959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1215/2447] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:36:27.925410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:27.926951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:28.032282 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b70f4-5f32-4c9b-82c7-c0347e3ca1a1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:28.038845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:28.039504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:28.039782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:28.040059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:28.049468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:28.051158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:28.064830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1233/2448] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:30.797067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c6a0-a3ce-4943-bd4a-ee166382583d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:30.797760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c6a0-a3ce-4943-bd4a-ee166382583d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:30.798015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c6a0-a3ce-4943-bd4a-ee166382583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:30.819877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6585c6a0-a3ce-4943-bd4a-ee166382583d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:30.821223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6585c6a0-a3ce-4943-bd4a-ee166382583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:30.830309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1216/2449] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:30.845583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:30.855571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:30.872163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d787c5-d863-45e8-850a-159e73612dfa service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:30.879058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:30.879600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:30.879877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:30.880145 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:30.888631 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:30.890252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:30.899969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1234/2450] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:31.614570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:31.614853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:31.615124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:31.637194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] MFA Rules not processed for user `0aa7040691be4940a0059eac5d638109`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:31.638696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:31.696412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1217/2451] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:33.027410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:33.029802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:33.065602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:33.067773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:33.108856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bda299-89fe-494f-924e-5f0ca6a53733 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:33.114737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ca9e4-709f-48ab-ad95-19c8361fe43f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:33.115424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca9e4-709f-48ab-ad95-19c8361fe43f service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:33.115721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca9e4-709f-48ab-ad95-19c8361fe43f service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:33.116069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca9e4-709f-48ab-ad95-19c8361fe43f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:33.118002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e5ca9e4-709f-48ab-ad95-19c8361fe43f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:33.130454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ca9e4-709f-48ab-ad95-19c8361fe43f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:33.132060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ca9e4-709f-48ab-ad95-19c8361fe43f service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:33.142418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1235/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:36:33.145885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880f4b8-140f-4b1b-85ee-3b20ae7f3ea8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:33.150942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:33.151562 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:33.151840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:33.152112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:33.160746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:33.162382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:33.173954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1218/2453] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:36:34.084745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e7fc-3294-42ff-bde8-f4d02e9f2981 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:34.085361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e7fc-3294-42ff-bde8-f4d02e9f2981 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:34.085361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e7fc-3294-42ff-bde8-f4d02e9f2981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:34.106049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0680e7fc-3294-42ff-bde8-f4d02e9f2981 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:34.107286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0680e7fc-3294-42ff-bde8-f4d02e9f2981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:34.116811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1236/2454] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:34.135474 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:34.152025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ceb50-7283-4d75-aff2-5eb95dca9d56 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:34.160057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:34.160725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:34.161007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:34.161255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:34.172219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:34.173904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:34.187328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1219/2455] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:37.146513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94458ca-5c55-4178-b6d7-721490b85816 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:37.147109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94458ca-5c55-4178-b6d7-721490b85816 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:37.147109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94458ca-5c55-4178-b6d7-721490b85816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:37.166619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a94458ca-5c55-4178-b6d7-721490b85816 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:37.167808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a94458ca-5c55-4178-b6d7-721490b85816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:37.175870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1237/2456] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:37.192720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:37.206384 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7427f-1ce0-4a81-8812-9a40e3f25b09 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:37.213720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:37.214315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:37.214586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:37.214861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:37.223723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:37.225307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:37.234574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1220/2457] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:41.382572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f26a-22b0-4f88-b514-00b8af168138 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:41.383164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f26a-22b0-4f88-b514-00b8af168138 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:41.383271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f26a-22b0-4f88-b514-00b8af168138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:41.405487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0619f26a-22b0-4f88-b514-00b8af168138 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:41.406719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0619f26a-22b0-4f88-b514-00b8af168138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:41.421323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1238/2458] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:41.438631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:41.445421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:41.452964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a023bb-c9db-409e-bdc9-e9cb1a4983ea service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:41.460559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:41.461169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:41.461476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:41.461746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:41.471196 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:41.472799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:41.483676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1221/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:44.555700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3a23b-7b0a-4246-b3a8-f8ad557e27c8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:44.556185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3a23b-7b0a-4246-b3a8-f8ad557e27c8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:44.556278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3a23b-7b0a-4246-b3a8-f8ad557e27c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:44.576809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6ee3a23b-7b0a-4246-b3a8-f8ad557e27c8 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:36:44.578026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6ee3a23b-7b0a-4246-b3a8-f8ad557e27c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:44.587446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1239/2460] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:36:44.624791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:44.638734 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41defeb-9de4-4b80-8216-9bf01455b655 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:44.645105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b3fb4-ad16-4085-a708-5d52c5592d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:44.645757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3fb4-ad16-4085-a708-5d52c5592d1e service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:44.646148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3fb4-ad16-4085-a708-5d52c5592d1e service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:44.646419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3fb4-ad16-4085-a708-5d52c5592d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:44.655260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b3fb4-ad16-4085-a708-5d52c5592d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:44.656891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b3fb4-ad16-4085-a708-5d52c5592d1e service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:44.666757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1222/2461] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:54.571218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:54.662232 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=11 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:02.170653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08873d4-d3d3-4c42-932a-762ccac0ad70 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:02.171140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08873d4-d3d3-4c42-932a-762ccac0ad70 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:02.171140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08873d4-d3d3-4c42-932a-762ccac0ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:02.191104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e08873d4-d3d3-4c42-932a-762ccac0ad70 None None] MFA Rules not processed for user `9081aa7047ae4ef0b1df7c7918ec1ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:02.192318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e08873d4-d3d3-4c42-932a-762ccac0ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:02.250732 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1240/2462] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:07.960185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bec8d-f697-4a1f-af38-5502e319f75f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:07.960732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bec8d-f697-4a1f-af38-5502e319f75f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:07.960732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bec8d-f697-4a1f-af38-5502e319f75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:07.982230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5f2bec8d-f697-4a1f-af38-5502e319f75f None None] MFA Rules not processed for user `d91359eb2ecb4b7391f579732a596602`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:07.983896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5f2bec8d-f697-4a1f-af38-5502e319f75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:08.040976 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1223/2463] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:12.242143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=25 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:17.464011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095fdc9-d5df-4378-bca3-181b64817a99 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:17.464689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095fdc9-d5df-4378-bca3-181b64817a99 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:17.464689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095fdc9-d5df-4378-bca3-181b64817a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:17.484556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8095fdc9-d5df-4378-bca3-181b64817a99 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:17.485936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8095fdc9-d5df-4378-bca3-181b64817a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:17.494389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1241/2464] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:17.509212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bec8d-f697-4a1f-af38-5502e319f75f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:17.522400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bec8d-f697-4a1f-af38-5502e319f75f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:17.527964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:17.528563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:17.528822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:17.529109 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:17.537033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:17.538661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:17.547763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1224/2465] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:20.758550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae5a9-a7de-4fc9-b06b-cff9f2fd7655 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:20.759161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae5a9-a7de-4fc9-b06b-cff9f2fd7655 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:20.759161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae5a9-a7de-4fc9-b06b-cff9f2fd7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:20.779868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ed6ae5a9-a7de-4fc9-b06b-cff9f2fd7655 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:20.781063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ed6ae5a9-a7de-4fc9-b06b-cff9f2fd7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:20.790628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1242/2466] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:20.806656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:20.818756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e715b89-3690-4825-a46e-35a039eedc75 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:20.825924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:20.826530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:20.826803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:20.827071 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:20.836007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:20.837643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:20.846961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1225/2467] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:23.853247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0395-8019-4cea-ae07-ec48de4bb0e9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:23.853869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0395-8019-4cea-ae07-ec48de4bb0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:23.853869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0395-8019-4cea-ae07-ec48de4bb0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:23.875246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8acc0395-8019-4cea-ae07-ec48de4bb0e9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:23.876475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8acc0395-8019-4cea-ae07-ec48de4bb0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:23.886075 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1243/2468] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:23.905678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:23.917219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e5fba-bdc7-4ad3-9689-06ad598c7eab service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:23.923926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:23.924521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:23.924798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:23.925069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:23.933398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:23.934997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:23.944690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1226/2469] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:27.030636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231e7a-9e19-4c4d-b794-d8df0dc3a1f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:27.031149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231e7a-9e19-4c4d-b794-d8df0dc3a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:27.031149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231e7a-9e19-4c4d-b794-d8df0dc3a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:27.051710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-59231e7a-9e19-4c4d-b794-d8df0dc3a1f1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:27.052904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-59231e7a-9e19-4c4d-b794-d8df0dc3a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:27.061917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1244/2470] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:27.081941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:27.095741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609c0d4-802d-4b1b-972b-bc090f8d54dd service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:27.102204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:27.102796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:27.103353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:27.103353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:27.111835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:27.113479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:27.123249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1227/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:30.219290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ef49-66af-4604-ab25-df714eb0d8e2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:30.219775 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ef49-66af-4604-ab25-df714eb0d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:30.219869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ef49-66af-4604-ab25-df714eb0d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:30.240159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9d51ef49-66af-4604-ab25-df714eb0d8e2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:30.241394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9d51ef49-66af-4604-ab25-df714eb0d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:30.250241 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1245/2472] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 8 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:30.273488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:30.284624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a3d7-198c-4d72-9bc2-d0c4dcd69320 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:30.290773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:30.291359 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:30.291694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:30.291977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:30.299923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:30.301538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:30.311525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1228/2473] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:40.235093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=15 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:40.306877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=55 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:49.176345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba1f62-8247-42a5-b140-edebbc0a0755 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:49.176907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba1f62-8247-42a5-b140-edebbc0a0755 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:49.176907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba1f62-8247-42a5-b140-edebbc0a0755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:49.198336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e0ba1f62-8247-42a5-b140-edebbc0a0755 None None] MFA Rules not processed for user `0aa7040691be4940a0059eac5d638109`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:37:49.199543 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e0ba1f62-8247-42a5-b140-edebbc0a0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:49.207893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1246/2474] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:37:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:37:59.191551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:01.343426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:01.345140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:01.365024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f123b-619f-43f2-a8fb-35eed4ebebdd service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:01.370672 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:01.371803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:01.372133 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:01.372408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] PATH_INFO: `/v3/users/9081aa7047ae4ef0b1df7c7918ec1ac0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:01.373656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9081aa7047ae4ef0b1df7c7918ec1ac0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:01.375604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:01.427411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9081aa7047ae4ef0b1df7c7918ec1ac0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.437265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9081aa7047ae4ef0b1df7c7918ec1ac0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.438121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9081aa7047ae4ef0b1df7c7918ec1ac0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.459446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9081aa7047ae4ef0b1df7c7918ec1ac0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.460228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6fd3f630-50ac-4a6e-a180-6dd67a2cb04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9081aa7047ae4ef0b1df7c7918ec1ac0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.478918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1229/2475] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:01 2022] DELETE /identity/v3/users/9081aa7047ae4ef0b1df7c7918ec1ac0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:01.754464 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba1f62-8247-42a5-b140-edebbc0a0755 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:01.769756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba1f62-8247-42a5-b140-edebbc0a0755 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:01.838236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:01.838974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:01.839431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:01.839766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] PATH_INFO: `/v3/projects/c1a617a502894490898d9d5054ece742` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:01.841066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a617a502894490898d9d5054ece742)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:01.843243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:01.903901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a617a502894490898d9d5054ece742', 'request_id': 'req-f5b78475-a85c-4cc9-8c2c-660df606c4aa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.910898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a617a502894490898d9d5054ece742', 'request_id': 'req-f5b78475-a85c-4cc9-8c2c-660df606c4aa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.923473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a617a502894490898d9d5054ece742', 'request_id': 'req-f5b78475-a85c-4cc9-8c2c-660df606c4aa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.941520 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] The token cache is being invalidate because project c1a617a502894490898d9d5054ece742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:01.941817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.942516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5b78475-a85c-4cc9-8c2c-660df606c4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:01.944720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1247/2476] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:01 2022] DELETE /identity/v3/projects/c1a617a502894490898d9d5054ece742 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:01.949725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b679-5fb9-43d2-9deb-6b17fc10a14f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:01.950004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b679-5fb9-43d2-9deb-6b17fc10a14f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:01.950447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b679-5fb9-43d2-9deb-6b17fc10a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:01.971136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a542b679-5fb9-43d2-9deb-6b17fc10a14f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:01.972361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a542b679-5fb9-43d2-9deb-6b17fc10a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:02.056014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1230/2477] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:02.065314 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75b49-4983-4fd8-8e5f-ead6f67aef14 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.065721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75b49-4983-4fd8-8e5f-ead6f67aef14 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.066066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75b49-4983-4fd8-8e5f-ead6f67aef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.086983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d1b75b49-4983-4fd8-8e5f-ead6f67aef14 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:02.088533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d1b75b49-4983-4fd8-8e5f-ead6f67aef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:02.097033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1248/2478] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:02.101675 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542b679-5fb9-43d2-9deb-6b17fc10a14f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:02.112057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542b679-5fb9-43d2-9deb-6b17fc10a14f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:02.117940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:02.118847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.119132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.119410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.120065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:38:02.120409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:02.122188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:02.138485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1231/2479] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:38:02.139721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75b49-4983-4fd8-8e5f-ead6f67aef14 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:02.153901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75b49-4983-4fd8-8e5f-ead6f67aef14 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:02.158896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:02.160275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.160275 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.160504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.161189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:02.163313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:02.198408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1249/2480] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:38:02 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:38:02.200894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:02.211201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b64e2c-2f8f-43d6-bbbd-bc4e2d1ae224 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:02.279129 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:02.279664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.279943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.280219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.280865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:02.296265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:02.319903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:02.348657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1232/2481] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:38:02 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:38:02.351961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:02.365560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2e143-29cb-4603-90de-f68ae34a6d8b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:02.371258 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:02.371905 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.372180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.372465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.373092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:02.375575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:02.392580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1250/2482] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:38:02.395929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:02.414533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfdd67-69c7-4186-9d55-d1d0201e010a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:02.419770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0ad29-bedd-420b-ad77-4e05af66a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:02.420661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0ad29-bedd-420b-ad77-4e05af66a5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.420942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0ad29-bedd-420b-ad77-4e05af66a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.421217 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0ad29-bedd-420b-ad77-4e05af66a5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.421930 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0ad29-bedd-420b-ad77-4e05af66a5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:02.423773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0ad29-bedd-420b-ad77-4e05af66a5f2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:02.448861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1233/2483] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:38:02.453104 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:02.464762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418ed17-2adf-431f-a8cb-c3b458f5dd91 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:02.469912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:02.470596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.470877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.471147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] PATH_INFO: `/v3/projects/e77490011664497eb368f75934cff395/users/532b334248ac4a028a027f07185c1188/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.488077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77490011664497eb368f75934cff395, user_id=532b334248ac4a028a027f07185c1188, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:02.491324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:02.510227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1251/2484] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:38:02 2022] PUT /identity/v3/projects/e77490011664497eb368f75934cff395/users/532b334248ac4a028a027f07185c1188/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:02.583333 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e5b6-5869-4c6a-b5d0-5a93764d0ea9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.583613 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e5b6-5869-4c6a-b5d0-5a93764d0ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.584228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e5b6-5869-4c6a-b5d0-5a93764d0ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.623767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-61b7e5b6-5869-4c6a-b5d0-5a93764d0ea9 None None] MFA Rules not processed for user `532b334248ac4a028a027f07185c1188`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:02.625193 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-61b7e5b6-5869-4c6a-b5d0-5a93764d0ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:02.692523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1234/2485] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:02.704624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:02.706347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:02.736981 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:02.766049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a8c7-b0f8-4efb-8fa0-9508530151bc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:02.769954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5950a-9881-4483-9ae3-22460c8a5e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:02.770579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5950a-9881-4483-9ae3-22460c8a5e59 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:02.770888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5950a-9881-4483-9ae3-22460c8a5e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:02.771158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5950a-9881-4483-9ae3-22460c8a5e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:02.779794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5950a-9881-4483-9ae3-22460c8a5e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:02.781270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5950a-9881-4483-9ae3-22460c8a5e59 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:02.790674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1252/2486] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:08.091938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e5b6-5869-4c6a-b5d0-5a93764d0ea9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:08.163192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e5b6-5869-4c6a-b5d0-5a93764d0ea9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:08.167721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:08.168400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:08.168700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:08.169720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] PATH_INFO: `/v3/users/532b334248ac4a028a027f07185c1188` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:08.170097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532b334248ac4a028a027f07185c1188)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:08.172453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:08.230694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532b334248ac4a028a027f07185c1188'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:08.239879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532b334248ac4a028a027f07185c1188'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:08.240782 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532b334248ac4a028a027f07185c1188'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:08.254224 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:08.255718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532b334248ac4a028a027f07185c1188'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:08.256686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532b334248ac4a028a027f07185c1188'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:08.272931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1235/2487] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:08 2022] DELETE /identity/v3/users/532b334248ac4a028a027f07185c1188 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:08.277882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:08.278359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:08.278548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:08.297509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:08.298714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:08.379849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1253/2488] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:08.395009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:08.397149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:08.513816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad50be-9a4c-4ba1-b916-68fd280c6920 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:08.520189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39a7b8-aee0-4e26-a1fb-8ebf8f45fff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:08.521386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a7b8-aee0-4e26-a1fb-8ebf8f45fff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:08.521818 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a7b8-aee0-4e26-a1fb-8ebf8f45fff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:08.522421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a7b8-aee0-4e26-a1fb-8ebf8f45fff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:08.537462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39a7b8-aee0-4e26-a1fb-8ebf8f45fff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:08.540160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39a7b8-aee0-4e26-a1fb-8ebf8f45fff4 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:08.554191 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1236/2489] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:08.931552 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:08.933097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:08.948210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae302-8596-4fe4-bc6c-ea926421414d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:08.954090 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:08.964194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:08.964401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:08.969911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] PATH_INFO: `/v3/projects/e77490011664497eb368f75934cff395` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:08.975195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77490011664497eb368f75934cff395)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:08.987948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:09.064509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77490011664497eb368f75934cff395', 'request_id': 'req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:09.071169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77490011664497eb368f75934cff395', 'request_id': 'req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:09.080021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77490011664497eb368f75934cff395', 'request_id': 'req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:09.093086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] The token cache is being invalidate because project e77490011664497eb368f75934cff395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:09.093507 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:09.094272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69fd8191-1cba-44e2-8e50-8f727e1e9ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:09.095868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1254/2490] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:08 2022] DELETE /identity/v3/projects/e77490011664497eb368f75934cff395 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:10.535742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:10.536299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:10.536409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:10.559300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] MFA Rules not processed for user `4da2d83be930445aa7ffba8e3a0116f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:10.560403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:10.618064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1237/2491] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:15.713747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99210a8-4400-42a2-98de-74a15a771432 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:15.714291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99210a8-4400-42a2-98de-74a15a771432 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:15.714291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99210a8-4400-42a2-98de-74a15a771432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:15.735168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c99210a8-4400-42a2-98de-74a15a771432 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:15.736897 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c99210a8-4400-42a2-98de-74a15a771432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:15.801526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:15.812595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1255/2492] 10.222.0.25 () {58 vars in 967 bytes} [Mon Aug 8 02:38:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:15.876636 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:15.878446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:15.959363 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c6b2-8e60-4d8c-855d-d43200b7e452 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:15.966486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5da3-2bc5-44de-a357-36ab503f13f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:15.966742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5da3-2bc5-44de-a357-36ab503f13f8 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:15.967054 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5da3-2bc5-44de-a357-36ab503f13f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:15.967418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5da3-2bc5-44de-a357-36ab503f13f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:15.979029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da5da3-2bc5-44de-a357-36ab503f13f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:15.981044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da5da3-2bc5-44de-a357-36ab503f13f8 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:15.996282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1238/2493] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:38:18.858198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8c31-1f37-402b-a293-1e21b240b18c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:18.858785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8c31-1f37-402b-a293-1e21b240b18c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:18.858969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8c31-1f37-402b-a293-1e21b240b18c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:18.860442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1256/2494] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:38:18.893533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:18.894403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:18.894835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:18.947430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] MFA Rules not processed for user `624d4aaae75d49a59610ebc30d150f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:18.948669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:18.967883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8c31-1f37-402b-a293-1e21b240b18c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:18.969788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f3ea8c31-1f37-402b-a293-1e21b240b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:18.997423 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:19.113698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1239/2495] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:38:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:19.129348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:19.130835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8c31-1f37-402b-a293-1e21b240b18c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:19.131074 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:19.135741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:19.136390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:19.136672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:19.137066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] PATH_INFO: `/v3/users/d91359eb2ecb4b7391f579732a596602` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:19.138643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91359eb2ecb4b7391f579732a596602)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:19.140730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:19.145700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e6e7c-6be7-44a3-b035-a842ab0764ff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:19.153066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:19.153970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:19.154471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:19.155431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:19.168473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:19.171104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:19.200982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1240/2496] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:19.209436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91359eb2ecb4b7391f579732a596602'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.234782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91359eb2ecb4b7391f579732a596602'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.253321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91359eb2ecb4b7391f579732a596602'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.254251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91359eb2ecb4b7391f579732a596602'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.254993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1c9e4d6f-ead1-4f7a-86cd-396bd58ed882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91359eb2ecb4b7391f579732a596602'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.269670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1257/2497] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:18 2022] DELETE /identity/v3/users/d91359eb2ecb4b7391f579732a596602 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:19.479874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:19.497289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e48e4a-fa1a-425b-b630-47f4c232e69d service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:19.580321 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:19.580960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:19.581235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:19.581549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] PATH_INFO: `/v3/projects/f3db5aab82444769b6069f200ac5dffa` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:19.582707 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3db5aab82444769b6069f200ac5dffa)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:19.584728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:19.641826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3db5aab82444769b6069f200ac5dffa', 'request_id': 'req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.648332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3db5aab82444769b6069f200ac5dffa', 'request_id': 'req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.658294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3db5aab82444769b6069f200ac5dffa', 'request_id': 'req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.669192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] The token cache is being invalidate because project f3db5aab82444769b6069f200ac5dffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:19.669524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.670194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d3e219cc-8c4c-4992-80b4-00ee3c7c1127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:19.671849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1241/2498] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:19 2022] DELETE /identity/v3/projects/f3db5aab82444769b6069f200ac5dffa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:19.676838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8123e7-5231-45c4-887a-b417f8a1dac3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:19.677185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8123e7-5231-45c4-887a-b417f8a1dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:19.677558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8123e7-5231-45c4-887a-b417f8a1dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:19.698342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2b8123e7-5231-45c4-887a-b417f8a1dac3 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:19.699545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2b8123e7-5231-45c4-887a-b417f8a1dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:19.767734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1258/2499] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:19.775777 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff029-23bc-40fa-98c0-2b4270013841 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:19.776070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff029-23bc-40fa-98c0-2b4270013841 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:19.776354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff029-23bc-40fa-98c0-2b4270013841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:19.798309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b7cff029-23bc-40fa-98c0-2b4270013841 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:19.799568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b7cff029-23bc-40fa-98c0-2b4270013841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:19.810879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1242/2500] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:19.813990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8123e7-5231-45c4-887a-b417f8a1dac3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:19.822722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8123e7-5231-45c4-887a-b417f8a1dac3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:19.827300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:19.827923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:19.828200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:19.828469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:19.829124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:38:19.829497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:19.831881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:19.847879 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1259/2501] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:38:19.849143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff029-23bc-40fa-98c0-2b4270013841 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:19.863604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff029-23bc-40fa-98c0-2b4270013841 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:19.869073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:19.869961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:19.870435 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:19.871566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:19.872379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:19.874691 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:19.918984 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1243/2502] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:38:19 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:38:19.922620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:19.930561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:19.935191 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eea22-1b3a-48fe-81e8-7fea2522a0c7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:20.027512 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:20.028060 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:20.028347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:20.028616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:20.029271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:20.031269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:20.069461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1260/2503] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:38:19 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:38:20.069900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:20.081946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca7263-8cfe-4765-9f0a-6bc4eb539d90 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:20.087855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:20.089115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:20.089115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:20.089311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:20.090339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:20.093096 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:20.096255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:20.111709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1244/2504] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:38:20.113231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:20.126183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec988a-06e1-49d3-be02-185ee3aac53f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:20.131424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daa5e3-9e12-4942-942c-aaa8045131e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:20.132155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daa5e3-9e12-4942-942c-aaa8045131e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:20.132584 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daa5e3-9e12-4942-942c-aaa8045131e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:20.132849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daa5e3-9e12-4942-942c-aaa8045131e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:20.133880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daa5e3-9e12-4942-942c-aaa8045131e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:20.135793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daa5e3-9e12-4942-942c-aaa8045131e0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:20.157790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:20.161882 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1261/2505] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:38:20.168604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61106-e1c3-444a-ac8e-ff01fd1c2568 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:20.174061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:20.174978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:20.175448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:20.175871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] PATH_INFO: `/v3/projects/cff4ea2758e04e3380ffdaeb6b730d2a/users/d7aec24c192f469dbc76a8e525f10497/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:20.193409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff4ea2758e04e3380ffdaeb6b730d2a, user_id=d7aec24c192f469dbc76a8e525f10497, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:20.196447 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:20.216938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1245/2506] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:38:20 2022] PUT /identity/v3/projects/cff4ea2758e04e3380ffdaeb6b730d2a/users/d7aec24c192f469dbc76a8e525f10497/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:20.223472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ebe1-583d-41b9-beff-aee715ed1451 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:20.223762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ebe1-583d-41b9-beff-aee715ed1451 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:20.224064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ebe1-583d-41b9-beff-aee715ed1451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:20.249725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9ad6ebe1-583d-41b9-beff-aee715ed1451 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:20.251034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9ad6ebe1-583d-41b9-beff-aee715ed1451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:20.347054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1262/2507] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:20.359068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:20.361324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:20.457511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72693e-807b-4be0-95b6-81e5ecc5f852 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:20.463759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:20.464483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:20.464856 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:20.465653 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:20.479073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:20.481424 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:20.494936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1246/2508] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:22.388304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6ebe1-583d-41b9-beff-aee715ed1451 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:22.405738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6ebe1-583d-41b9-beff-aee715ed1451 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:22.414754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:22.416819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:22.417108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:22.417519 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:22.421709 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:22.549247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:22.550681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:22.569474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1263/2509] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:22.907591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:22.922591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a1d7-e609-4206-b0f9-f10d7adc137c service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:22.939114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9471758-6a7d-4c5c-8e7c-2e73181c18a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:22.939745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471758-6a7d-4c5c-8e7c-2e73181c18a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:22.940016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471758-6a7d-4c5c-8e7c-2e73181c18a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:22.940418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471758-6a7d-4c5c-8e7c-2e73181c18a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:22.942774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f9471758-6a7d-4c5c-8e7c-2e73181c18a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:22.965733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9471758-6a7d-4c5c-8e7c-2e73181c18a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:22.967201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9471758-6a7d-4c5c-8e7c-2e73181c18a0 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:23.000263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1247/2510] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:26.663421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:26.664957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:26.682646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8779fe-cb42-4565-99a6-1a2dd6c9bd07 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:26.688797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:26.689639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:26.689914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:26.690190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] PATH_INFO: `/v3/users/2fc50d836012416c8b646ec76fa91828` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:26.691349 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc50d836012416c8b646ec76fa91828)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:26.693532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:26.696753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:26.754306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc50d836012416c8b646ec76fa91828'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:26.763265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc50d836012416c8b646ec76fa91828'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:26.775157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc50d836012416c8b646ec76fa91828'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:26.775801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc50d836012416c8b646ec76fa91828'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:26.776415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc50d836012416c8b646ec76fa91828'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:26.797529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1264/2511] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:26 2022] DELETE /identity/v3/users/2fc50d836012416c8b646ec76fa91828 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:26.874348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:26.874814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:26.874909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:26.907248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] MFA Rules not processed for user `d7aec24c192f469dbc76a8e525f10497`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:26.910466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:26.984784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1248/2512] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:26.996444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:26.998329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:27.004986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:27.006938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:27.070269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:27.099050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5125dd2-af0f-445c-b20d-56bbb70e7861 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:27.102585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60132b-2d5d-4b7b-a5a3-daf57e71592f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:27.104025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:27.104680 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:27.104960 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:27.105230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] PATH_INFO: `/v3/projects/7e8b4539a9e9491d8797b286a9782d6a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:27.107095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8b4539a9e9491d8797b286a9782d6a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:27.109025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:27.111183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:27.111884 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:27.112248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:27.112584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:27.121199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:27.122924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:27.136288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1249/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:27.177417 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8b4539a9e9491d8797b286a9782d6a', 'request_id': 'req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.186803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8b4539a9e9491d8797b286a9782d6a', 'request_id': 'req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.204810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8b4539a9e9491d8797b286a9782d6a', 'request_id': 'req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.230389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] The token cache is being invalidate because project 7e8b4539a9e9491d8797b286a9782d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:27.230685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.231341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.233414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1265/2514] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:26 2022] DELETE /identity/v3/projects/7e8b4539a9e9491d8797b286a9782d6a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:27.237233 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:27.265334 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28bfe-e065-4cbb-9935-72b300e8cf3d service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:27.353031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:27.353710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:27.354022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:27.354292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] PATH_INFO: `/v3/users/ec8670baae0545eeb481da83c481f929` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:27.355671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8670baae0545eeb481da83c481f929)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:27.357662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:27.421927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8670baae0545eeb481da83c481f929'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.431595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8670baae0545eeb481da83c481f929'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.432343 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8670baae0545eeb481da83c481f929'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.446650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8670baae0545eeb481da83c481f929'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.447420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07d10c1a-7680-4e7c-9538-bcfa498a584d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8670baae0545eeb481da83c481f929'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.463879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1250/2515] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:27 2022] DELETE /identity/v3/users/ec8670baae0545eeb481da83c481f929 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:27.723574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:27.725198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:27.740054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415d8b1-e36d-4602-9feb-bfefcd0e56d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:27.750697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:27.823365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:27.823365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:27.823648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:27.823859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] PATH_INFO: `/v3/projects/a22ccb3371d64e27bdc68a86526d8700` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:27.825467 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22ccb3371d64e27bdc68a86526d8700)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:27.827391 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:27.883843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22ccb3371d64e27bdc68a86526d8700', 'request_id': 'req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.890364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22ccb3371d64e27bdc68a86526d8700', 'request_id': 'req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.899489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22ccb3371d64e27bdc68a86526d8700', 'request_id': 'req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.912082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] The token cache is being invalidate because project a22ccb3371d64e27bdc68a86526d8700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:27.912583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.913204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:27.914778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1266/2516] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:27 2022] DELETE /identity/v3/projects/a22ccb3371d64e27bdc68a86526d8700 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:28.639746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:28.640276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:28.640372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:28.659846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] MFA Rules not processed for user `d7aec24c192f469dbc76a8e525f10497`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:28.660573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:28.718626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1251/2517] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:36.659645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:36.661331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:36.744999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c789292-ec9a-4ff7-8ca5-3521a0dc580b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:36.752096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:36.752728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:36.753006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:36.753284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:36.755628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:36.798646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:36.822850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:36.824492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:36.833811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1267/2518] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:38.711682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:46.829570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:50.345335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:50.346847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:50.405671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae3651-9f5e-4784-a43c-9c664da371b2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:50.409634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:50.410257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:50.410538 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:50.410810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:50.412862 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:50.479846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:50.481346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:50.492075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1252/2519] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:53.662192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:53.663753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:53.678031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e41c9-e63b-4e38-8271-95e8cc9060bb service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:53.683508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:53.684209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:53.684483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:53.684753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] PATH_INFO: `/v3/users/0aa7040691be4940a0059eac5d638109` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:53.686048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa7040691be4940a0059eac5d638109)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:53.688426 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:53.739049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa7040691be4940a0059eac5d638109'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:53.748604 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa7040691be4940a0059eac5d638109'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:53.761327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa7040691be4940a0059eac5d638109'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:53.762045 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa7040691be4940a0059eac5d638109'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:53.762671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-16f9dedb-884a-47de-9d72-223bde58ae7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa7040691be4940a0059eac5d638109'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:53.776227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1268/2520] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:53 2022] DELETE /identity/v3/users/0aa7040691be4940a0059eac5d638109 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:53.964990 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:53.976347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55701-fb61-4bcf-8ace-38aec1ddbc46 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.039610 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.040246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.040523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.040793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] PATH_INFO: `/v3/projects/24d55693a031439badd9ac6e71655574` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.042221 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d55693a031439badd9ac6e71655574)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.044263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.094954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d55693a031439badd9ac6e71655574', 'request_id': 'req-627aa61a-3363-4918-99cf-6f8fd7846e26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:54.096759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:54.102049 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d55693a031439badd9ac6e71655574', 'request_id': 'req-627aa61a-3363-4918-99cf-6f8fd7846e26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:54.111457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d55693a031439badd9ac6e71655574', 'request_id': 'req-627aa61a-3363-4918-99cf-6f8fd7846e26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:54.123138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] The token cache is being invalidate because project 24d55693a031439badd9ac6e71655574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:54.123437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:54.124099 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-627aa61a-3363-4918-99cf-6f8fd7846e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:54.125660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1253/2521] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:53 2022] DELETE /identity/v3/projects/24d55693a031439badd9ac6e71655574 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:54.130863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5e2a-f745-480a-aa65-c23a15f7cff1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.131094 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5e2a-f745-480a-aa65-c23a15f7cff1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.131397 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5e2a-f745-480a-aa65-c23a15f7cff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.153276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f22f5e2a-f745-480a-aa65-c23a15f7cff1 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:54.154576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f22f5e2a-f745-480a-aa65-c23a15f7cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:54.219595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1269/2522] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:54.228661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf3a5-3bab-4a1d-9cda-f6066f5fadb8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.229027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf3a5-3bab-4a1d-9cda-f6066f5fadb8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.229302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf3a5-3bab-4a1d-9cda-f6066f5fadb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.252963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a08cf3a5-3bab-4a1d-9cda-f6066f5fadb8 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:54.254732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a08cf3a5-3bab-4a1d-9cda-f6066f5fadb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:54.266250 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1254/2523] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:54.271231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f5e2a-f745-480a-aa65-c23a15f7cff1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.287414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f5e2a-f745-480a-aa65-c23a15f7cff1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.295116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.295724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.296000 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.296272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.296924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:38:54.297223 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.298887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.311646 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1270/2524] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:38:54.316420 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cf3a5-3bab-4a1d-9cda-f6066f5fadb8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.326206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cf3a5-3bab-4a1d-9cda-f6066f5fadb8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.332137 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.332725 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.332997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.333264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.333918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.335836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.366658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1255/2525] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:38:54 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:38:54.371063 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.381166 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6b46e-213f-4c86-a8ec-341093f1addd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.441237 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.441885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.442204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.442484 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.443118 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.445089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.453210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:54.470777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1271/2526] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:38:54 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:38:54.475310 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.488002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aed8b-2c51-47a6-9d4e-be072d6a4e75 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.493404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.494034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.494282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.494552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.495194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.496944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.507448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1256/2527] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:38:54.511715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.522715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccb097-4cd4-49a8-9828-8a2e2419a450 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.528701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa255946-e2b0-4e0f-862e-75b4eafce8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.529303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255946-e2b0-4e0f-862e-75b4eafce8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.529610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255946-e2b0-4e0f-862e-75b4eafce8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.529880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255946-e2b0-4e0f-862e-75b4eafce8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.530523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa255946-e2b0-4e0f-862e-75b4eafce8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.532106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa255946-e2b0-4e0f-862e-75b4eafce8bb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.543693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1272/2528] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:38:54.548311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.558589 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567133b7-2a35-4db3-9122-a4da6157c736 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.563626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.564290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.564565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.564836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] PATH_INFO: `/v3/projects/231dfc62bba34121952a9eb8cdf43a97/users/592b0f584014417594cafbf680a3d826/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.582861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231dfc62bba34121952a9eb8cdf43a97, user_id=592b0f584014417594cafbf680a3d826, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.585587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.605773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1257/2529] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:38:54 2022] PUT /identity/v3/projects/231dfc62bba34121952a9eb8cdf43a97/users/592b0f584014417594cafbf680a3d826/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:54.618469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5c3a-fca0-4872-87d9-6b969f971b3c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.618835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5c3a-fca0-4872-87d9-6b969f971b3c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.619144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5c3a-fca0-4872-87d9-6b969f971b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.647900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-512f5c3a-fca0-4872-87d9-6b969f971b3c None None] MFA Rules not processed for user `592b0f584014417594cafbf680a3d826`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:54.648996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-512f5c3a-fca0-4872-87d9-6b969f971b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:54.725854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1273/2530] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:54.732759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.800704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5252f-1cc8-4754-80c5-0f8208a2aa47 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.805816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.806411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.806715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.806977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.807612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.809608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.838503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1258/2531] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:38:54 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:38:54.845348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f5c3a-fca0-4872-87d9-6b969f971b3c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.859665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f5c3a-fca0-4872-87d9-6b969f971b3c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.925992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.926627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.926899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.927175 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.927881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.929877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.955440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1274/2532] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:38:54 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:38:54.959726 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:54.970936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b14e-aa3d-4579-951e-b6e7c68835f5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:54.976128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:54.976745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:54.977038 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:54.977337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:54.977996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:54.979639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:54.991295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1259/2533] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:38:54.995715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:55.006799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35301-10fe-46cf-a6f7-763f4cbcfdfa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:55.012946 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:55.013636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:55.013912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:55.014182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] PATH_INFO: `/v3/projects/2e49c2e644d044d0a423610613c69684/users/1c233abe45ec4ffa9ea363be4be8520b/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:55.031493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e49c2e644d044d0a423610613c69684, user_id=1c233abe45ec4ffa9ea363be4be8520b, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:55.034212 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:55.050359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1275/2534] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:38:54 2022] PUT /identity/v3/projects/2e49c2e644d044d0a423610613c69684/users/1c233abe45ec4ffa9ea363be4be8520b/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:38:55.054608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:55.065681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d21d3b-8b7a-4156-bc6a-0baa901395b4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:55.116362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:55.128428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489f84a-f9d2-4e38-af3c-a5868f7b33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:55.129084 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f84a-f9d2-4e38-af3c-a5868f7b33bf admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:55.129387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f84a-f9d2-4e38-af3c-a5868f7b33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:55.129677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f84a-f9d2-4e38-af3c-a5868f7b33bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:55.130323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489f84a-f9d2-4e38-af3c-a5868f7b33bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:55.132561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489f84a-f9d2-4e38-af3c-a5868f7b33bf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:55.143120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1260/2535] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:38:55.147656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:55.158500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab2a5-c71a-499f-9bf0-16f9f349637d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:55.163797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:55.164453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:55.164731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:55.165007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] PATH_INFO: `/v3/projects/2e49c2e644d044d0a423610613c69684/users/1c233abe45ec4ffa9ea363be4be8520b/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:55.167030 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e49c2e644d044d0a423610613c69684, user_id=1c233abe45ec4ffa9ea363be4be8520b, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:55.169788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:55.180171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1276/2536] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:38:55 2022] PUT /identity/v3/projects/2e49c2e644d044d0a423610613c69684/users/1c233abe45ec4ffa9ea363be4be8520b/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:55.191190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5fd8a-923e-414b-af45-d0a61c834d04 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:55.191472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5fd8a-923e-414b-af45-d0a61c834d04 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:55.191748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5fd8a-923e-414b-af45-d0a61c834d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:55.220304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d2c5fd8a-923e-414b-af45-d0a61c834d04 None None] MFA Rules not processed for user `1c233abe45ec4ffa9ea363be4be8520b`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:38:55.221616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d2c5fd8a-923e-414b-af45-d0a61c834d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:55.297135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1261/2537] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:38:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:38:55.309053 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:55.311431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:55.335115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:55.374926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf116dc-55ed-4a0e-8fea-5a5493d75bbd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:55.379031 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:55.379663 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:55.379924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:55.380192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:55.390077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:55.391577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:55.400957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1277/2538] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:55.500000 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5fd8a-923e-414b-af45-d0a61c834d04 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:55.509917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5fd8a-923e-414b-af45-d0a61c834d04 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:55.514177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:55.514780 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:55.515060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:55.515358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:55.574113 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:55.575593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:55.584547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1262/2539] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:05.396727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=17 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:05.580900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=68 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:14.179416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:14.180912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:14.294942 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbb971-3686-48a9-99f3-f3bc95389df5 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:14.301253 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:14.302143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:14.302726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:14.303322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:14.305568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:14.319263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:14.320865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:14.335325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1278/2540] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:22.304943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:22.306669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:22.391644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1631-9871-4043-817a-39fd6bb12c6d service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:22.397092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:22.398127 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:22.398522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:22.399264 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] PATH_INFO: `/v3/users/4da2d83be930445aa7ffba8e3a0116f8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:22.400694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da2d83be930445aa7ffba8e3a0116f8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:22.403543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:22.474325 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da2d83be930445aa7ffba8e3a0116f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.484198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da2d83be930445aa7ffba8e3a0116f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.485556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da2d83be930445aa7ffba8e3a0116f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.498803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da2d83be930445aa7ffba8e3a0116f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.499481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-600b38b1-f662-4ad7-a7ac-8fdf1ea3b02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da2d83be930445aa7ffba8e3a0116f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.512945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1263/2541] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:22 2022] DELETE /identity/v3/users/4da2d83be930445aa7ffba8e3a0116f8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:22.708668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:22.721330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fad20-5481-40a0-9dea-dc63a4c9e06f service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:22.786920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:22.787591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:22.787874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:22.788146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] PATH_INFO: `/v3/projects/afe8c5f3d0b744c1995c3f2bec122097` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:22.789300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe8c5f3d0b744c1995c3f2bec122097)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:22.791263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:22.846435 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe8c5f3d0b744c1995c3f2bec122097', 'request_id': 'req-48cd041a-18eb-47a6-a4bb-0963c1de32a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.853406 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe8c5f3d0b744c1995c3f2bec122097', 'request_id': 'req-48cd041a-18eb-47a6-a4bb-0963c1de32a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.865077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe8c5f3d0b744c1995c3f2bec122097', 'request_id': 'req-48cd041a-18eb-47a6-a4bb-0963c1de32a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.877206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] The token cache is being invalidate because project afe8c5f3d0b744c1995c3f2bec122097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:22.877558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.878215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48cd041a-18eb-47a6-a4bb-0963c1de32a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:22.879771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1279/2542] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:22 2022] DELETE /identity/v3/projects/afe8c5f3d0b744c1995c3f2bec122097 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:22.884925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548646d-5701-4200-96dd-f329a50a6a6e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:22.885229 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548646d-5701-4200-96dd-f329a50a6a6e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:22.885526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548646d-5701-4200-96dd-f329a50a6a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:22.905712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3548646d-5701-4200-96dd-f329a50a6a6e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:22.906932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3548646d-5701-4200-96dd-f329a50a6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:22.972383 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1264/2543] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:22.980818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ebbc-4fd0-4939-8dd1-9eb440eafa9d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:22.981200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ebbc-4fd0-4939-8dd1-9eb440eafa9d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:22.981399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ebbc-4fd0-4939-8dd1-9eb440eafa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.001262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d4d5ebbc-4fd0-4939-8dd1-9eb440eafa9d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:23.002527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d4d5ebbc-4fd0-4939-8dd1-9eb440eafa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:23.010858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1280/2544] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:23.015415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548646d-5701-4200-96dd-f329a50a6a6e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:23.025783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548646d-5701-4200-96dd-f329a50a6a6e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:23.030893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:23.031645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.031929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.032197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.032855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:23.033156 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:23.034846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:23.050370 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1265/2545] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:39:23.057089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ebbc-4fd0-4939-8dd1-9eb440eafa9d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:23.067306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ebbc-4fd0-4939-8dd1-9eb440eafa9d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:23.072924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:23.073561 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.073847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.074117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.074746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:23.076672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:23.082071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:23.107157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1281/2546] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:23 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:23.111483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:23.121445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c883f-7b41-48ee-9f8a-f0f740b4b509 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:23.125014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:23.182465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:23.183085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.183387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.183670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.184290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:23.186295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:23.210332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1266/2547] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:23 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:23.216123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:23.227103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415defb-56c2-4688-8154-8447ea23cc56 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:23.232857 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:23.233493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.233774 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.234048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.234727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:23.236338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:23.247323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1282/2548] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:23.251889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:23.263807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0292d-138e-40c1-91ae-d71e137b0c4e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:23.269851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab44ec-07fd-4e80-9d26-354585598249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:23.270490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab44ec-07fd-4e80-9d26-354585598249 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.270767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab44ec-07fd-4e80-9d26-354585598249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.271035 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab44ec-07fd-4e80-9d26-354585598249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.271700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab44ec-07fd-4e80-9d26-354585598249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:23.273395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab44ec-07fd-4e80-9d26-354585598249 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:23.285257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1267/2549] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:23.289645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:23.302311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a079-8d4a-41fb-820d-f21905452a80 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:23.307840 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:23.308657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.309012 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.309290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] PATH_INFO: `/v3/projects/0a606591a2f140f29481089460b0869f/users/ab88fa4294af4f438c9889ace2bdeaa7/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.326499 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a606591a2f140f29481089460b0869f, user_id=ab88fa4294af4f438c9889ace2bdeaa7, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:23.329324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:23.347585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1283/2550] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:23 2022] PUT /identity/v3/projects/0a606591a2f140f29481089460b0869f/users/ab88fa4294af4f438c9889ace2bdeaa7/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:23.352945 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308f3d-da15-488b-9c10-dec5056da279 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.353579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308f3d-da15-488b-9c10-dec5056da279 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.353579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308f3d-da15-488b-9c10-dec5056da279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.373403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a9308f3d-da15-488b-9c10-dec5056da279 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:23.374533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9308f3d-da15-488b-9c10-dec5056da279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:23.446497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1268/2551] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:23.459623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:23.461949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:23.525196 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465067a7-e8b2-465b-af64-8ee5981aae4b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:23.529689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:23.530339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:23.530619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:23.530892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:23.541304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:23.542810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:23.552668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1284/2552] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:24.230286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517813a7-73c2-4972-ba68-6fccc0f02051 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:24.230649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517813a7-73c2-4972-ba68-6fccc0f02051 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:24.230997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517813a7-73c2-4972-ba68-6fccc0f02051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:24.264612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-517813a7-73c2-4972-ba68-6fccc0f02051 None None] MFA Rules not processed for user `ab88fa4294af4f438c9889ace2bdeaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:24.265995 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-517813a7-73c2-4972-ba68-6fccc0f02051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:24.338771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1269/2553] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:24.343279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:24.353485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae310-c014-4d70-8ef3-71b824e4d6cb service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:24.358889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:24.359715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:24.360156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:24.360440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:24.361066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:24.363032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:24.393457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1285/2554] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:24 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:24.397646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517813a7-73c2-4972-ba68-6fccc0f02051 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:24.411911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517813a7-73c2-4972-ba68-6fccc0f02051 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:24.425270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:24.473391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:24.474015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:24.474294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:24.474565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:24.475214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:24.477157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:24.503374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1270/2555] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:24 2022] POST /identity/v3/users => generated 307 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:24.507533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:24.518299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff298d0-b923-4685-b8b7-64b9b721ee9d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:24.523234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:24.523841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:24.524127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:24.524405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:24.525054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:24.526814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:24.537390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1286/2556] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:24.541545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:24.552047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635df50-5069-427e-8207-629a0d771f91 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:24.557292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:24.558110 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:24.558385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:24.558655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] PATH_INFO: `/v3/projects/fb423e22a6d249f2bd6ce69e5b812350/users/ab198f36ddb5463badc87376445b569f/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:24.574732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb423e22a6d249f2bd6ce69e5b812350, user_id=ab198f36ddb5463badc87376445b569f, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:24.577533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:24.593522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1271/2557] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:24 2022] PUT /identity/v3/projects/fb423e22a6d249f2bd6ce69e5b812350/users/ab198f36ddb5463badc87376445b569f/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:24.597579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:24.608260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9c21-ff22-4075-b7c5-004a69da2432 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:24.667462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb7f5c-bd11-435d-b1f8-069747b66de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:24.668146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb7f5c-bd11-435d-b1f8-069747b66de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:24.668428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb7f5c-bd11-435d-b1f8-069747b66de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:24.668702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb7f5c-bd11-435d-b1f8-069747b66de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:24.669352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb7f5c-bd11-435d-b1f8-069747b66de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:24.671299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb7f5c-bd11-435d-b1f8-069747b66de4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:24.681931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1287/2558] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:24.686508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:24.697608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44283465-63d0-4619-8d34-664874491c85 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:24.702896 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:24.703569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:24.703850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:24.704121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] PATH_INFO: `/v3/projects/fb423e22a6d249f2bd6ce69e5b812350/users/ab198f36ddb5463badc87376445b569f/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:24.706267 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb423e22a6d249f2bd6ce69e5b812350, user_id=ab198f36ddb5463badc87376445b569f, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:24.708926 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:24.719838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1272/2559] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:24 2022] PUT /identity/v3/projects/fb423e22a6d249f2bd6ce69e5b812350/users/ab198f36ddb5463badc87376445b569f/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:25.366730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e593-2b07-4bbf-b82a-e3ae6c5b2fe9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:25.367229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e593-2b07-4bbf-b82a-e3ae6c5b2fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:25.367350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e593-2b07-4bbf-b82a-e3ae6c5b2fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:25.399839 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-32d7e593-2b07-4bbf-b82a-e3ae6c5b2fe9 None None] MFA Rules not processed for user `ab198f36ddb5463badc87376445b569f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:25.401686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-32d7e593-2b07-4bbf-b82a-e3ae6c5b2fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:25.408546 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:25.442203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:25.443986 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:25.489697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1288/2560] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:25 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:25.516369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc48d3-be7f-4a07-8317-2ed1d06655e2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:25.524104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:25.524837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:25.525433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:25.525785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] PATH_INFO: `/v3/users/592b0f584014417594cafbf680a3d826` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:25.527833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592b0f584014417594cafbf680a3d826)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:25.530238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:25.594198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592b0f584014417594cafbf680a3d826'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:25.602294 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592b0f584014417594cafbf680a3d826'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:25.602978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592b0f584014417594cafbf680a3d826'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:25.618973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:25.620674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592b0f584014417594cafbf680a3d826'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:25.621536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592b0f584014417594cafbf680a3d826'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:25.641592 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1273/2561] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:25 2022] DELETE /identity/v3/users/592b0f584014417594cafbf680a3d826 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:25.643874 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:25.644185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:25.644461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:25.663459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:25.664737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:25.732867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1289/2562] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:25.742973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:25.744530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:25.802359 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f08e7-5ded-41a0-a983-4218ca5f3cc9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:25.806130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:25.806758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:25.807036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:25.807348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:25.817329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:25.818846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:25.829838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1274/2563] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:26.127523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:26.129100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:26.142697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2e153-61d4-4637-982b-68e5b3daf50e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:26.147345 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:26.147993 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:26.148329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:26.148607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] PATH_INFO: `/v3/projects/231dfc62bba34121952a9eb8cdf43a97` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:26.149778 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231dfc62bba34121952a9eb8cdf43a97)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:26.152672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:26.210803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231dfc62bba34121952a9eb8cdf43a97', 'request_id': 'req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.217883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231dfc62bba34121952a9eb8cdf43a97', 'request_id': 'req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.227598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231dfc62bba34121952a9eb8cdf43a97', 'request_id': 'req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.239789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] The token cache is being invalidate because project 231dfc62bba34121952a9eb8cdf43a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:26.240062 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.240756 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.242596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1290/2564] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:26 2022] DELETE /identity/v3/projects/231dfc62bba34121952a9eb8cdf43a97 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:26.246903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:26.257105 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40735-db9d-4e0e-8ac8-cdaa897a67cf service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:26.319555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:26.320297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:26.320579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:26.320859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] PATH_INFO: `/v3/users/1c233abe45ec4ffa9ea363be4be8520b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:26.322178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c233abe45ec4ffa9ea363be4be8520b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:26.324935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:26.382218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c233abe45ec4ffa9ea363be4be8520b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.392655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c233abe45ec4ffa9ea363be4be8520b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.393391 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c233abe45ec4ffa9ea363be4be8520b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.407662 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c233abe45ec4ffa9ea363be4be8520b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.408563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c233abe45ec4ffa9ea363be4be8520b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.422147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1275/2565] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:26 2022] DELETE /identity/v3/users/1c233abe45ec4ffa9ea363be4be8520b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:26.684954 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:26.686974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:26.701392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa2205-e276-40ad-86d6-d0f0f9e5f0c7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:26.726961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:26.762463 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:26.763101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:26.763432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:26.763705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] PATH_INFO: `/v3/users/ab88fa4294af4f438c9889ace2bdeaa7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:26.764992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab88fa4294af4f438c9889ace2bdeaa7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:26.766909 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:26.776171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:26.777712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:26.800786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8b58b-606b-4c73-b202-cfeb4b226f9c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:26.808004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:26.809689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:26.810085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:26.810360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] PATH_INFO: `/v3/projects/2e49c2e644d044d0a423610613c69684` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:26.812422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e49c2e644d044d0a423610613c69684)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:26.814542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:26.817104 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:26.822765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab88fa4294af4f438c9889ace2bdeaa7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.832164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab88fa4294af4f438c9889ace2bdeaa7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.845089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab88fa4294af4f438c9889ace2bdeaa7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.846057 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab88fa4294af4f438c9889ace2bdeaa7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.846816 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-581400f0-8907-4ef3-8ef9-159f128a47ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab88fa4294af4f438c9889ace2bdeaa7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.860124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1291/2566] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:26 2022] DELETE /identity/v3/users/ab88fa4294af4f438c9889ace2bdeaa7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:26.867400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e49c2e644d044d0a423610613c69684', 'request_id': 'req-07c0cb12-5326-490e-84e4-9b0a5e9963e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.873768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e49c2e644d044d0a423610613c69684', 'request_id': 'req-07c0cb12-5326-490e-84e4-9b0a5e9963e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.883356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e49c2e644d044d0a423610613c69684', 'request_id': 'req-07c0cb12-5326-490e-84e4-9b0a5e9963e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.894678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] The token cache is being invalidate because project 2e49c2e644d044d0a423610613c69684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:26.894964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.895587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07c0cb12-5326-490e-84e4-9b0a5e9963e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:26.897302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1276/2567] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:26 2022] DELETE /identity/v3/projects/2e49c2e644d044d0a423610613c69684 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:26.903252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4bfa-84f4-4199-bd49-1f29ef91299b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:26.903539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4bfa-84f4-4199-bd49-1f29ef91299b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:26.903808 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4bfa-84f4-4199-bd49-1f29ef91299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:26.924625 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-87df4bfa-84f4-4199-bd49-1f29ef91299b None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:26.925987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-87df4bfa-84f4-4199-bd49-1f29ef91299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:26.988078 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1292/2568] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:26.996389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:26.996762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:26.997036 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.017741 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:27.018879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.027594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1277/2569] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:27.032043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df4bfa-84f4-4199-bd49-1f29ef91299b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.042639 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df4bfa-84f4-4199-bd49-1f29ef91299b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.047465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.048246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.048599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.048936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.049266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.049830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:27.050127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.050703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.051851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.065790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1293/2570] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:39:27.067754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83c559-e96e-4847-ada2-7049e3a5ef22 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.069912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.073716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.074563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.074846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.075255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] PATH_INFO: `/v3/projects/0a606591a2f140f29481089460b0869f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.076529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a606591a2f140f29481089460b0869f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.079296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.084801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294fd35-c6be-4f03-ac89-e23a99f24bc5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.089790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.090392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.090666 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.091013 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.091581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.093536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.127361 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1294/2571] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:27.128670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.131027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a606591a2f140f29481089460b0869f', 'request_id': 'req-24e35d6c-f718-4d43-8f06-05eaa68f3c32'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.139062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a606591a2f140f29481089460b0869f', 'request_id': 'req-24e35d6c-f718-4d43-8f06-05eaa68f3c32'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.150140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a606591a2f140f29481089460b0869f', 'request_id': 'req-24e35d6c-f718-4d43-8f06-05eaa68f3c32'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.157679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:27.176849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] The token cache is being invalidate because project 0a606591a2f140f29481089460b0869f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:27.177162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.177977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.186941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1278/2572] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:27 2022] DELETE /identity/v3/projects/0a606591a2f140f29481089460b0869f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:27.188827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.190569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.230262 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68425e-8887-4c3e-b916-c734a41e42fa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.235603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.236193 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.236469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.236835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.237390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.239339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.265992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1295/2573] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:27.266212 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e35d6c-f718-4d43-8f06-05eaa68f3c32 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.270445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.271083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.271891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.272177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.272455 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] PATH_INFO: `/v3/users/ab198f36ddb5463badc87376445b569f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.273689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab198f36ddb5463badc87376445b569f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.275621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.275763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.288551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:27.290762 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f61b0-cb5b-46f7-94b1-ab7e834c41ce admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.297139 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.297841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.298307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.298432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.298999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.300726 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.313518 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1296/2574] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:27.318069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.329878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddaf63-3756-4f92-a114-43146900fa8e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.334786 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.335465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.335754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.336028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.336693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.337089 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab198f36ddb5463badc87376445b569f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.338502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.345593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab198f36ddb5463badc87376445b569f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.346248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab198f36ddb5463badc87376445b569f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.350093 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1297/2575] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:27.354352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.359459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab198f36ddb5463badc87376445b569f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.360162 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dc3e697d-d339-4272-b05d-3e05b8f11f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab198f36ddb5463badc87376445b569f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.364164 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4af1-5eee-40fd-8561-29a0f2955f58 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.368696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.369331 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.369875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.370216 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] PATH_INFO: `/v3/projects/5303ed1d1e214240a8f627e05a3b1e2a/users/196969f17b624f54afdd8446c1a55a5a/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.372846 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1279/2576] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:27 2022] DELETE /identity/v3/users/ab198f36ddb5463badc87376445b569f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:27.386244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5303ed1d1e214240a8f627e05a3b1e2a, user_id=196969f17b624f54afdd8446c1a55a5a, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.389265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.404736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1298/2577] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:27 2022] PUT /identity/v3/projects/5303ed1d1e214240a8f627e05a3b1e2a/users/196969f17b624f54afdd8446c1a55a5a/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:27.415339 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.415635 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.415915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.450709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] MFA Rules not processed for user `196969f17b624f54afdd8446c1a55a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:27.451912 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.522198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1280/2578] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:27.526885 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.529022 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.553781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.555276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.638541 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9eabea-2e03-4505-88b4-ed2946ac174d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.643291 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.643965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.644235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.644507 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] PATH_INFO: `/v3/projects/fb423e22a6d249f2bd6ce69e5b812350` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.645718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb423e22a6d249f2bd6ce69e5b812350)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.647664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.672166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:27.704787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb423e22a6d249f2bd6ce69e5b812350', 'request_id': 'req-8e071646-10c9-4d16-81fc-4b8436c3d88b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.711357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb423e22a6d249f2bd6ce69e5b812350', 'request_id': 'req-8e071646-10c9-4d16-81fc-4b8436c3d88b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.721467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb423e22a6d249f2bd6ce69e5b812350', 'request_id': 'req-8e071646-10c9-4d16-81fc-4b8436c3d88b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.733169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] The token cache is being invalidate because project fb423e22a6d249f2bd6ce69e5b812350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:27.733664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.734317 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e071646-10c9-4d16-81fc-4b8436c3d88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:27.735861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1281/2579] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:27 2022] DELETE /identity/v3/projects/fb423e22a6d249f2bd6ce69e5b812350 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:27.737271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d911be2-7ef5-4aa6-b455-ee1f5e4db7ab admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.740566 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcea9f4-6088-41ca-8817-a775d3309560 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.740838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcea9f4-6088-41ca-8817-a775d3309560 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.741135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcea9f4-6088-41ca-8817-a775d3309560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.763879 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fdcea9f4-6088-41ca-8817-a775d3309560 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:27.765266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fdcea9f4-6088-41ca-8817-a775d3309560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.798930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.799214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.799488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.799777 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.800442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.802502 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.808154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:27.828200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1282/2580] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:27.835438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1299/2581] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/projects => generated 379 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:27.835905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0524-e943-4f1b-93c3-867dc997ac99 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.836192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0524-e943-4f1b-93c3-867dc997ac99 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.836301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.836471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0524-e943-4f1b-93c3-867dc997ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.837988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.858266 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-47ec0524-e943-4f1b-93c3-867dc997ac99 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:27.859468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-47ec0524-e943-4f1b-93c3-867dc997ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:27.901500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a480ce-39b7-4666-8b94-dc2ac6ebb40d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.906721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.907356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.907645 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.907916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.908540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.910576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.919208 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1283/2582] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:27.923200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0524-e943-4f1b-93c3-867dc997ac99 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.931799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0524-e943-4f1b-93c3-867dc997ac99 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.937223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.937849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.938101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.938386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.939005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:27.939306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.940897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.942276 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1300/2583] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:27.943168 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.953161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cfb49-6958-4c86-a1ed-74293abf0ac7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.953871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1284/2584] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:39:27.958374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.958563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.959056 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.959337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.959731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.960411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.962027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.968194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cce86b-dae6-4049-92f8-11c385e4b171 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.973288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.974022 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.974278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.974575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.974964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1301/2585] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:27.975171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.977309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:27.979135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:27.989319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516878e-1339-4e59-973e-7ae20b2e9345 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:27.994620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:27.995473 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:27.995927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:27.996206 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:27.996834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:27.998617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.009567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1302/2586] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:28.013688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1285/2587] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:27 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:28.014449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.016794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.025017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7a55c-d8cd-4645-975f-429a85eed25e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.030170 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:28.083245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49423fc-8abe-4aad-b5d8-401089e0b2c9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.087847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.088481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.088759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.089112 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.089864 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.091861 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.098883 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.099555 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.099865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.100144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] PATH_INFO: `/v3/projects/7d4395de7434440785f1995eb9947375/users/3d0b16055add4039809d45756ee714b5/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.115670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4395de7434440785f1995eb9947375, user_id=3d0b16055add4039809d45756ee714b5, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.118340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.120963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1286/2588] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:28.122283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.124564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:28.134642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1303/2589] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:28 2022] PUT /identity/v3/projects/7d4395de7434440785f1995eb9947375/users/3d0b16055add4039809d45756ee714b5/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:28.142281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.187795 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:28.198030 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a663bd8-b97f-4a6f-9234-272a6c6266c8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.209341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34009100-0eb2-46a2-ba37-a7a98afbd6f7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.214040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3e219-b80c-4adb-b093-e46f5d7b3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.214648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e219-b80c-4adb-b093-e46f5d7b3721 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.214925 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e219-b80c-4adb-b093-e46f5d7b3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.215195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e219-b80c-4adb-b093-e46f5d7b3721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.215829 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3e219-b80c-4adb-b093-e46f5d7b3721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.217457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3e219-b80c-4adb-b093-e46f5d7b3721 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.227272 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1304/2590] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:28.228517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9d624-d4ca-45d4-baaa-3a45adb1ea06 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.228803 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9d624-d4ca-45d4-baaa-3a45adb1ea06 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.229171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9d624-d4ca-45d4-baaa-3a45adb1ea06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.257603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0fa9d624-d4ca-45d4-baaa-3a45adb1ea06 None None] MFA Rules not processed for user `3d0b16055add4039809d45756ee714b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:28.258834 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0fa9d624-d4ca-45d4-baaa-3a45adb1ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:28.262079 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.262695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.262975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.263247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.265006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:28.276489 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.278121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.288062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1287/2591] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:28.288936 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.299103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9e9c2-1fc7-4407-9cf1-f5536f31a4ce service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.310356 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.310978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.311263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.311540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.312559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.314319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.329559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1288/2592] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:28.329703 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1305/2593] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:28.330659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.332235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9d624-d4ca-45d4-baaa-3a45adb1ea06 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.341698 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66775107-5e5f-483a-a1c9-1f5f66e5e2d6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.343229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9d624-d4ca-45d4-baaa-3a45adb1ea06 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.346776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcf92b-2858-4049-9984-747ca0ba30d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.347537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcf92b-2858-4049-9984-747ca0ba30d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.347883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcf92b-2858-4049-9984-747ca0ba30d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.348285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcf92b-2858-4049-9984-747ca0ba30d2 admin admin] PATH_INFO: `/v3/projects/b3a0e750fb60401bbe7477e819b7e146/users/269b9e64b28b42e1b5dd3ac2456ea0dd/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.348843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.349567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.349915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.350239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.350975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.353221 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.366403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcf92b-2858-4049-9984-747ca0ba30d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a0e750fb60401bbe7477e819b7e146, user_id=269b9e64b28b42e1b5dd3ac2456ea0dd, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.370092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcf92b-2858-4049-9984-747ca0ba30d2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.381720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:28.386506 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1306/2594] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:28.389644 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1289/2595] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:28 2022] PUT /identity/v3/projects/b3a0e750fb60401bbe7477e819b7e146/users/269b9e64b28b42e1b5dd3ac2456ea0dd/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:28.390509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.403469 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b529-63a6-4209-8b90-bb4c1c43094c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.403931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b529-63a6-4209-8b90-bb4c1c43094c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.404599 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b529-63a6-4209-8b90-bb4c1c43094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.437542 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c953b529-63a6-4209-8b90-bb4c1c43094c None None] MFA Rules not processed for user `269b9e64b28b42e1b5dd3ac2456ea0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:28.439098 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c953b529-63a6-4209-8b90-bb4c1c43094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:28.458873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55142c52-1e9e-40c0-9c99-e20293012534 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.463691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.464311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.464590 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.464862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.465526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.467579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.492529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1307/2596] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:28.496718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.507849 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766d0d-8b3f-4c8f-8292-18a13198baf5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.513733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.514344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.514620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.514890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.515531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.517119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.527929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1308/2597] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:28.532220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.532688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1290/2598] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:28.536764 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b529-63a6-4209-8b90-bb4c1c43094c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.541971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401d141-c718-4248-b89a-88d410524b2a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.546783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.547440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.547717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.547990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] PATH_INFO: `/v3/projects/5cbd98c1c6c4426991cff381081b3df8/users/28b6dfdf90274f8ab1e17b2ff07606ee/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.548213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b529-63a6-4209-8b90-bb4c1c43094c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.552915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.553642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.553983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.554320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.555007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.556981 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.563038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbd98c1c6c4426991cff381081b3df8, user_id=28b6dfdf90274f8ab1e17b2ff07606ee, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.565688 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.568963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:28.582542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1309/2599] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:28 2022] PUT /identity/v3/projects/5cbd98c1c6c4426991cff381081b3df8/users/28b6dfdf90274f8ab1e17b2ff07606ee/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:28.586671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.587073 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1291/2600] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:28.591564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.650728 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adad7d-3e3c-423f-a82a-a4475cdfdfee admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.655558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.656172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.656447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.656718 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.657414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.659018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.659200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bda140-c2f0-4446-b0fb-6dee4023721b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.663682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.664287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.664561 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.664833 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.665477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.667571 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.668994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1310/2601] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:28.673228 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.683226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc102cb-8ff8-4fca-a61b-2528f2866c47 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.689055 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5877ac-d240-473e-bdba-fc82bacdd942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.689748 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5877ac-d240-473e-bdba-fc82bacdd942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.690034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5877ac-d240-473e-bdba-fc82bacdd942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.690375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5877ac-d240-473e-bdba-fc82bacdd942 admin admin] PATH_INFO: `/v3/projects/5cbd98c1c6c4426991cff381081b3df8/users/28b6dfdf90274f8ab1e17b2ff07606ee/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.692293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5877ac-d240-473e-bdba-fc82bacdd942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbd98c1c6c4426991cff381081b3df8, user_id=28b6dfdf90274f8ab1e17b2ff07606ee, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.692663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1292/2602] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:28.695219 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5877ac-d240-473e-bdba-fc82bacdd942 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.696553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.706243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1311/2603] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:28 2022] PUT /identity/v3/projects/5cbd98c1c6c4426991cff381081b3df8/users/28b6dfdf90274f8ab1e17b2ff07606ee/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:28.706872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76aa9-45af-4c26-9c5c-1f4c18da10bb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.716396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.716683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.716952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.745601 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] MFA Rules not processed for user `28b6dfdf90274f8ab1e17b2ff07606ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:28.746811 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:28.758916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:28.766315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.767183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.767502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.767778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.768811 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.770495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.781159 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1293/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:28.785314 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.795045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af3ba-795e-4eca-bc22-7c6a0dc79a85 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.799601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.800371 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.800545 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.800756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] PATH_INFO: `/v3/projects/20224050c18f4c9bb01788f26774df9f/users/295b18b19f4a4f0aa9483bd9dd4d6910/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.816098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1312/2605] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:28.817601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20224050c18f4c9bb01788f26774df9f, user_id=295b18b19f4a4f0aa9483bd9dd4d6910, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.819034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.827948 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.829638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:28.834906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1294/2606] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:28 2022] PUT /identity/v3/projects/20224050c18f4c9bb01788f26774df9f/users/295b18b19f4a4f0aa9483bd9dd4d6910/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:28.838958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.887996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12d14-f629-40c7-a9f2-05a2968b06b6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.900887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7aaf-ed28-4ed9-a9e9-4a3109577e7a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.905961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:28.906147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.906460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.906738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.907034 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.907674 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.909513 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.919762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1295/2607] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:28.923847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:28.934594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458882a-b45c-4e1a-a5a1-ccbbce6def24 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:28.940564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f4411-79e6-4827-9f9b-588359df2421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.941205 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f4411-79e6-4827-9f9b-588359df2421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.941593 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f4411-79e6-4827-9f9b-588359df2421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.941870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f4411-79e6-4827-9f9b-588359df2421 admin admin] PATH_INFO: `/v3/projects/20224050c18f4c9bb01788f26774df9f/users/295b18b19f4a4f0aa9483bd9dd4d6910/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.943748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f4411-79e6-4827-9f9b-588359df2421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20224050c18f4c9bb01788f26774df9f, user_id=295b18b19f4a4f0aa9483bd9dd4d6910, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:28.943975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:28.944586 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.944862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.945127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.946697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f4411-79e6-4827-9f9b-588359df2421 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:28.957992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1296/2608] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:28 2022] PUT /identity/v3/projects/20224050c18f4c9bb01788f26774df9f/users/295b18b19f4a4f0aa9483bd9dd4d6910/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:28.968974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111aa1-0090-4c6f-bfcf-135bea705f1a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:28.969260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111aa1-0090-4c6f-bfcf-135bea705f1a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:28.969565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111aa1-0090-4c6f-bfcf-135bea705f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:28.998123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-dc111aa1-0090-4c6f-bfcf-135bea705f1a None None] MFA Rules not processed for user `295b18b19f4a4f0aa9483bd9dd4d6910`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:28.999472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dc111aa1-0090-4c6f-bfcf-135bea705f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:29.005624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:29.007059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:29.016755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1313/2609] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:29.060638 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:29.062523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:29.071733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1297/2610] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:29.074527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9afa-2eae-43b4-a772-9e85fd9010e3 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:29.083083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc111aa1-0090-4c6f-bfcf-135bea705f1a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:29.125704 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:29.126418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a051fa-fcf6-4884-bbef-dae4d91861eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:29.127084 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a051fa-fcf6-4884-bbef-dae4d91861eb service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:29.127393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a051fa-fcf6-4884-bbef-dae4d91861eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:29.127665 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a051fa-fcf6-4884-bbef-dae4d91861eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:29.129636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e5a051fa-fcf6-4884-bbef-dae4d91861eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:29.141431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc111aa1-0090-4c6f-bfcf-135bea705f1a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:29.144974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:29.145630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:29.145905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:29.146171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:29.155236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:29.156669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:29.165816 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1298/2611] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:29.193324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a051fa-fcf6-4884-bbef-dae4d91861eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:29.195516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a051fa-fcf6-4884-bbef-dae4d91861eb service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:29.205873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1314/2612] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:29.602631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:29.676322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43470971-edc8-4bbe-b503-5e57d22ade9b service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:29.681389 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:29.682042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:29.682457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:29.682752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] PATH_INFO: `/v3/users/269b9e64b28b42e1b5dd3ac2456ea0dd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:29.683974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269b9e64b28b42e1b5dd3ac2456ea0dd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:29.686025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:29.736940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269b9e64b28b42e1b5dd3ac2456ea0dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:29.744157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269b9e64b28b42e1b5dd3ac2456ea0dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:29.744959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269b9e64b28b42e1b5dd3ac2456ea0dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:29.757271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269b9e64b28b42e1b5dd3ac2456ea0dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:29.757918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269b9e64b28b42e1b5dd3ac2456ea0dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:29.769750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1299/2613] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:29 2022] DELETE /identity/v3/users/269b9e64b28b42e1b5dd3ac2456ea0dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:29.774379 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:29.774845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:29.774959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:29.796810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:29.798501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:29.820051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:29.869753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1315/2614] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:29.880136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:29.882570 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:29.944817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5208f-9bb6-4457-bac9-515cccb7b4b6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:29.948906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:29.949678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:29.949972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:29.950240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:29.959703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:29.961147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:29.970841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1300/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:30.254924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:30.256478 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:30.270500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8ac2-c87b-48e7-8f6d-a191aa69e3df None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:30.276711 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:30.277471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:30.277685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:30.277969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] PATH_INFO: `/v3/projects/b3a0e750fb60401bbe7477e819b7e146` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:30.279340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a0e750fb60401bbe7477e819b7e146)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:30.281303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:30.330194 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a0e750fb60401bbe7477e819b7e146', 'request_id': 'req-8003a4a6-8902-4353-b154-db86859cb2b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.336475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a0e750fb60401bbe7477e819b7e146', 'request_id': 'req-8003a4a6-8902-4353-b154-db86859cb2b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.346074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a0e750fb60401bbe7477e819b7e146', 'request_id': 'req-8003a4a6-8902-4353-b154-db86859cb2b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.358320 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] The token cache is being invalidate because project b3a0e750fb60401bbe7477e819b7e146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:30.358679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.359556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.361859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1316/2616] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:30 2022] DELETE /identity/v3/projects/b3a0e750fb60401bbe7477e819b7e146 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:30.368168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:30.373627 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:30.379277 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21050-79e2-46b2-854d-742c9c126a35 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:30.437203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:30.437852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:30.438125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:30.438393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] PATH_INFO: `/v3/users/295b18b19f4a4f0aa9483bd9dd4d6910` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:30.439509 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295b18b19f4a4f0aa9483bd9dd4d6910)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:30.441426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:30.498826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295b18b19f4a4f0aa9483bd9dd4d6910'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.507872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295b18b19f4a4f0aa9483bd9dd4d6910'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.508487 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295b18b19f4a4f0aa9483bd9dd4d6910'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.524258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295b18b19f4a4f0aa9483bd9dd4d6910'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.525203 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7b6b197d-3ad7-4463-9e3c-e8e5dcb64698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295b18b19f4a4f0aa9483bd9dd4d6910'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:30.538350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1301/2617] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:30 2022] DELETE /identity/v3/users/295b18b19f4a4f0aa9483bd9dd4d6910 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:30.905238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:30.906870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:30.923390 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003a4a6-8902-4353-b154-db86859cb2b6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:30.988761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:30.989610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:30.989983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:30.990366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] PATH_INFO: `/v3/projects/20224050c18f4c9bb01788f26774df9f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:30.991564 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20224050c18f4c9bb01788f26774df9f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:30.993471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.044332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20224050c18f4c9bb01788f26774df9f', 'request_id': 'req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:31.045841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:31.052571 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20224050c18f4c9bb01788f26774df9f', 'request_id': 'req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:31.062297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20224050c18f4c9bb01788f26774df9f', 'request_id': 'req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:31.075598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] The token cache is being invalidate because project 20224050c18f4c9bb01788f26774df9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:31.075888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:31.076517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a051f712-1d1f-4a6a-84d9-ad45c8743eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:31.078279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1317/2618] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:30 2022] DELETE /identity/v3/projects/20224050c18f4c9bb01788f26774df9f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:31.083063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a44c-8fee-441d-a91b-bed50d40430d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.083530 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a44c-8fee-441d-a91b-bed50d40430d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.083625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a44c-8fee-441d-a91b-bed50d40430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.104842 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b542a44c-8fee-441d-a91b-bed50d40430d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:31.106534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b542a44c-8fee-441d-a91b-bed50d40430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:31.167563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1302/2619] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:31.175405 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816ab16-fd20-45cf-a7f6-5f564f70b802 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.175686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816ab16-fd20-45cf-a7f6-5f564f70b802 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.175953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816ab16-fd20-45cf-a7f6-5f564f70b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.196040 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a816ab16-fd20-45cf-a7f6-5f564f70b802 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:31.197238 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a816ab16-fd20-45cf-a7f6-5f564f70b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:31.205447 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1318/2620] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:31.209597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542a44c-8fee-441d-a91b-bed50d40430d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.220146 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542a44c-8fee-441d-a91b-bed50d40430d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.226712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.227492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.227814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.228124 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.228885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:31.229167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.231013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.245934 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1303/2621] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:39:31.250558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816ab16-fd20-45cf-a7f6-5f564f70b802 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.262051 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816ab16-fd20-45cf-a7f6-5f564f70b802 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.269904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.270723 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.271058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.271440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.272402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.275424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.308304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1319/2622] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:31 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:31.312873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.323952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146458dc-e9e8-43e2-bd49-1932ae550903 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.329228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:31.388844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.389475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.389756 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.390027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.390634 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.392568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.414985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1304/2623] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:31 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:31.419342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.429662 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46c66-b8e8-4e87-acef-de5b87ba6fa8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.434672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.435266 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.435544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.435810 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.436451 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.438424 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.448873 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1320/2624] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:31.452762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.463068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f5666-7aae-4dea-8b8a-e7b85dc25b74 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.471533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394031b-0dab-473b-a170-a349376e7321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.472298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394031b-0dab-473b-a170-a349376e7321 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.472602 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394031b-0dab-473b-a170-a349376e7321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.472871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394031b-0dab-473b-a170-a349376e7321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.473799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394031b-0dab-473b-a170-a349376e7321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.476214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394031b-0dab-473b-a170-a349376e7321 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.488329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1305/2625] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:31.492635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.503527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132e281-ff32-4fd3-b047-5162ecb68d3e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.509113 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.509751 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.510028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.510298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] PATH_INFO: `/v3/projects/415c4aacdedc44e5b8f2b5e69736646f/users/5fd00a1ef41e4130a5c640ea41cf4cff/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.527548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415c4aacdedc44e5b8f2b5e69736646f, user_id=5fd00a1ef41e4130a5c640ea41cf4cff, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.531779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.549966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1321/2626] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:31 2022] PUT /identity/v3/projects/415c4aacdedc44e5b8f2b5e69736646f/users/5fd00a1ef41e4130a5c640ea41cf4cff/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:31.561832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbdc7a-f8c9-42f0-9cf1-321b3fc734d0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.562130 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbdc7a-f8c9-42f0-9cf1-321b3fc734d0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.562403 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbdc7a-f8c9-42f0-9cf1-321b3fc734d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.592727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-78bbdc7a-f8c9-42f0-9cf1-321b3fc734d0 None None] MFA Rules not processed for user `5fd00a1ef41e4130a5c640ea41cf4cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:31.594007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-78bbdc7a-f8c9-42f0-9cf1-321b3fc734d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:31.664630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1306/2627] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:31.670021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.743503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75a90-a784-4f74-b789-3fed7a518e05 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.749142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.749800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.750074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.750336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.750952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.752877 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.783325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1322/2628] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:31 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:31.787583 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbdc7a-f8c9-42f0-9cf1-321b3fc734d0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.799902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbdc7a-f8c9-42f0-9cf1-321b3fc734d0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.873234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.873903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.874213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.874491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.875128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.877078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.900332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1307/2629] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:31 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:31.904658 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.915310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3b13-af9a-4213-a035-e603b415dc6a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.921357 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.922132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.922414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.922687 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.923420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.925332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.937264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1323/2630] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:31.941763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:31.951927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eac8c-8deb-46ec-9ce6-eff0f941c313 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:31.957070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:31.957745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:31.958026 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:31.958306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] PATH_INFO: `/v3/projects/7c04cd5feddc46c68484f8fbd97c2ed7/users/05e4a8740b7f4c77a95fdb3e5f29d5ed/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:31.960578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:31.979064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c04cd5feddc46c68484f8fbd97c2ed7, user_id=05e4a8740b7f4c77a95fdb3e5f29d5ed, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:31.981932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:31.998598 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1308/2631] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:31 2022] PUT /identity/v3/projects/7c04cd5feddc46c68484f8fbd97c2ed7/users/05e4a8740b7f4c77a95fdb3e5f29d5ed/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:32.002610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:32.012966 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc43b1-a23a-44da-ae54-87cddb8f4d8b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:32.057705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:32.072410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f866e-ba9b-437a-ac50-c560274074de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:32.073029 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f866e-ba9b-437a-ac50-c560274074de admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.073679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f866e-ba9b-437a-ac50-c560274074de admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.073679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f866e-ba9b-437a-ac50-c560274074de admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.074396 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f866e-ba9b-437a-ac50-c560274074de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:32.076676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f866e-ba9b-437a-ac50-c560274074de admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:32.090695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1324/2632] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:32.092152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:32.102968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d379f-2988-4bd8-9877-0ebb17aeeb46 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:32.109953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:32.110624 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.110897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.111194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] PATH_INFO: `/v3/projects/7c04cd5feddc46c68484f8fbd97c2ed7/users/05e4a8740b7f4c77a95fdb3e5f29d5ed/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.113643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c04cd5feddc46c68484f8fbd97c2ed7, user_id=05e4a8740b7f4c77a95fdb3e5f29d5ed, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:32.116281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:32.129396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1309/2633] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:32 2022] PUT /identity/v3/projects/7c04cd5feddc46c68484f8fbd97c2ed7/users/05e4a8740b7f4c77a95fdb3e5f29d5ed/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:32.139650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.139963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.140239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.168259 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] MFA Rules not processed for user `05e4a8740b7f4c77a95fdb3e5f29d5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:32.169661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.211690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:32.213670 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.240864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1325/2634] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:32.252915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:32.254288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.282058 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d9339-8b87-42f6-847f-b55e997df356 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:32.286759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:32.287495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.287666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.287937 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] PATH_INFO: `/v3/users/196969f17b624f54afdd8446c1a55a5a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.289087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196969f17b624f54afdd8446c1a55a5a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:32.291047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:32.310365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b99fed-9853-48c7-996a-8a9e922919d8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:32.315715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc523ed9-96f2-461b-b325-9a0ebd65ca9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:32.316328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc523ed9-96f2-461b-b325-9a0ebd65ca9d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.316647 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc523ed9-96f2-461b-b325-9a0ebd65ca9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.316836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc523ed9-96f2-461b-b325-9a0ebd65ca9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.326752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc523ed9-96f2-461b-b325-9a0ebd65ca9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:32.328300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc523ed9-96f2-461b-b325-9a0ebd65ca9d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:32.339169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1326/2635] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:32.344427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196969f17b624f54afdd8446c1a55a5a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.352980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196969f17b624f54afdd8446c1a55a5a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.353755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196969f17b624f54afdd8446c1a55a5a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.367014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196969f17b624f54afdd8446c1a55a5a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.367760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196969f17b624f54afdd8446c1a55a5a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.381135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1310/2636] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:32 2022] DELETE /identity/v3/users/196969f17b624f54afdd8446c1a55a5a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:32.385523 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.385809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.385931 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:32.386081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.387214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.407135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:32.408366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.445158 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:32.448709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585b6a-1d9e-4693-b909-9235f078b9f4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:32.453318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:32.453972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.454304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.454880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.457525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.467250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1327/2637] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:32.477296 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:32.479097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.492950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:32.518714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:32.520188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:32.529631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1311/2638] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:32.539859 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5ac34-5d2d-4f18-b800-8f92af79e88c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:32.543559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:32.544341 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.544801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.545001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.554156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:32.555607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:32.565465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1328/2639] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:32.883375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:32.884894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:32.902533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9d51-0d67-4e1f-a658-70fe88292ceb service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:32.907452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:32.908101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:32.908382 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:32.908659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] PATH_INFO: `/v3/projects/5303ed1d1e214240a8f627e05a3b1e2a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:32.909927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5303ed1d1e214240a8f627e05a3b1e2a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:32.911886 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:32.963315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5303ed1d1e214240a8f627e05a3b1e2a', 'request_id': 'req-0bfb319f-df7b-4e7e-b94d-8531833d7561'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.969459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5303ed1d1e214240a8f627e05a3b1e2a', 'request_id': 'req-0bfb319f-df7b-4e7e-b94d-8531833d7561'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.980323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5303ed1d1e214240a8f627e05a3b1e2a', 'request_id': 'req-0bfb319f-df7b-4e7e-b94d-8531833d7561'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.992004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] The token cache is being invalidate because project 5303ed1d1e214240a8f627e05a3b1e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:32.992292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.992968 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:32.994595 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1312/2640] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:32 2022] DELETE /identity/v3/projects/5303ed1d1e214240a8f627e05a3b1e2a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:32.999218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:33.009049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1b83-a177-4a7d-b66f-7d4273742395 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:33.068650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:33.069225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:33.069583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:33.069860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] PATH_INFO: `/v3/users/3d0b16055add4039809d45756ee714b5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:33.071115 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0b16055add4039809d45756ee714b5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:33.073041 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:33.127689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0b16055add4039809d45756ee714b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.139401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0b16055add4039809d45756ee714b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.152474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0b16055add4039809d45756ee714b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.153203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0b16055add4039809d45756ee714b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.153950 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0b16055add4039809d45756ee714b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.166602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1329/2641] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:32 2022] DELETE /identity/v3/users/3d0b16055add4039809d45756ee714b5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:33.450211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:33.451774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:33.467178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb319f-df7b-4e7e-b94d-8531833d7561 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:33.525985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:33.526649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:33.526929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:33.527194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] PATH_INFO: `/v3/projects/7d4395de7434440785f1995eb9947375` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:33.528428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4395de7434440785f1995eb9947375)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:33.530397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:33.564955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:33.581769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4395de7434440785f1995eb9947375', 'request_id': 'req-8e126636-6284-47bd-b2a7-ad0cc0043c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.587939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4395de7434440785f1995eb9947375', 'request_id': 'req-8e126636-6284-47bd-b2a7-ad0cc0043c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.598243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4395de7434440785f1995eb9947375', 'request_id': 'req-8e126636-6284-47bd-b2a7-ad0cc0043c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.609791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] The token cache is being invalidate because project 7d4395de7434440785f1995eb9947375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:33.610082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.610785 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.612309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1313/2642] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:33 2022] DELETE /identity/v3/projects/7d4395de7434440785f1995eb9947375 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:33.616514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:33.617959 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:33.631476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99b76-24b6-427a-bc28-0691c90958f5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:33.665401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:33.700962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:33.701933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:33.702217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:33.702522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] PATH_INFO: `/v3/users/28b6dfdf90274f8ab1e17b2ff07606ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:33.703686 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b6dfdf90274f8ab1e17b2ff07606ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:33.705657 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:33.757573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b6dfdf90274f8ab1e17b2ff07606ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.766801 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b6dfdf90274f8ab1e17b2ff07606ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.779671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b6dfdf90274f8ab1e17b2ff07606ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.780376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b6dfdf90274f8ab1e17b2ff07606ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.781126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b060376-8909-453b-a999-e3cf8a6afcde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b6dfdf90274f8ab1e17b2ff07606ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:33.794106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1330/2643] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:33 2022] DELETE /identity/v3/users/28b6dfdf90274f8ab1e17b2ff07606ee => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:34.090227 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.091815 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:34.107569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e126636-6284-47bd-b2a7-ad0cc0043c99 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.186020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.187140 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.187467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.187744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] PATH_INFO: `/v3/projects/5cbd98c1c6c4426991cff381081b3df8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.189178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbd98c1c6c4426991cff381081b3df8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.191118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.240305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbd98c1c6c4426991cff381081b3df8', 'request_id': 'req-79d8221f-0065-432b-8245-d740d6ff38a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:34.247761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbd98c1c6c4426991cff381081b3df8', 'request_id': 'req-79d8221f-0065-432b-8245-d740d6ff38a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:34.256376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbd98c1c6c4426991cff381081b3df8', 'request_id': 'req-79d8221f-0065-432b-8245-d740d6ff38a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:34.268943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] The token cache is being invalidate because project 5cbd98c1c6c4426991cff381081b3df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:34.269239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:34.269944 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-79d8221f-0065-432b-8245-d740d6ff38a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:34.271774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1314/2644] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:34 2022] DELETE /identity/v3/projects/5cbd98c1c6c4426991cff381081b3df8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:34.277508 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690256b9-54dd-4a77-bc2f-2d117b77322a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.278004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690256b9-54dd-4a77-bc2f-2d117b77322a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.278134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690256b9-54dd-4a77-bc2f-2d117b77322a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.302634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-690256b9-54dd-4a77-bc2f-2d117b77322a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:34.303864 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-690256b9-54dd-4a77-bc2f-2d117b77322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:34.378724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1331/2645] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:34.388967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed076b7-882a-45a7-adcc-6152a11430fc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.389255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed076b7-882a-45a7-adcc-6152a11430fc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.389558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed076b7-882a-45a7-adcc-6152a11430fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.413240 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5ed076b7-882a-45a7-adcc-6152a11430fc None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:34.414591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5ed076b7-882a-45a7-adcc-6152a11430fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:34.424640 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1315/2646] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:34.429338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690256b9-54dd-4a77-bc2f-2d117b77322a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.440092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690256b9-54dd-4a77-bc2f-2d117b77322a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.445095 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.445765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.446032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.446342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.446988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:34.447288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.448902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.461328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1332/2647] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:39:34.466045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed076b7-882a-45a7-adcc-6152a11430fc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.475510 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed076b7-882a-45a7-adcc-6152a11430fc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.480183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.480817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.481097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.481404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.482042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.484837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.514720 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1316/2648] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:34 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:34.518636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.528541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa825-1eed-4bc6-8aeb-a3aa4e48debd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.571250 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:34.589672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.590274 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.590550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.590817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.591437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.593431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.617346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1333/2649] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:34 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:34.622013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.633116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d62e6b-06d4-489d-a624-69b8961dad2f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.637938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.638524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.638794 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.639059 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.639705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.641473 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.651564 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1317/2650] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:34.655832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.666353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f32f-7bb5-4fab-9f6c-a4090a101a10 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.672393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf7564-049f-4140-8b69-db9959b7ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.673344 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf7564-049f-4140-8b69-db9959b7ea00 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.673870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf7564-049f-4140-8b69-db9959b7ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.674172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf7564-049f-4140-8b69-db9959b7ea00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.674828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf7564-049f-4140-8b69-db9959b7ea00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.676414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf7564-049f-4140-8b69-db9959b7ea00 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.688317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1334/2651] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:34.693587 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.710138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e538-0c6d-4b57-a4a7-27e76443f8dc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.717467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.718202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.718478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.718814 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] PATH_INFO: `/v3/projects/faa579bb88e34167853bed348131e4c2/users/e8c1b4c519814d24b9ce94390caa376f/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.722092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:34.737239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa579bb88e34167853bed348131e4c2, user_id=e8c1b4c519814d24b9ce94390caa376f, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.739992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.755732 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1318/2652] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:34 2022] PUT /identity/v3/projects/faa579bb88e34167853bed348131e4c2/users/e8c1b4c519814d24b9ce94390caa376f/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:34.767285 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b6fa-b0dc-484d-8859-83f40086196c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.767572 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b6fa-b0dc-484d-8859-83f40086196c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.767841 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b6fa-b0dc-484d-8859-83f40086196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.795148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e5f1b6fa-b0dc-484d-8859-83f40086196c None None] MFA Rules not processed for user `e8c1b4c519814d24b9ce94390caa376f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:34.796352 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e5f1b6fa-b0dc-484d-8859-83f40086196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:34.869481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1335/2653] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:34.881963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:34.883792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:34.944549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fae5aa-baf5-4527-a1c5-25877008136d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:34.948353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d08ea-4781-4743-a7f3-faf695ae0c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:34.948964 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d08ea-4781-4743-a7f3-faf695ae0c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:34.949241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d08ea-4781-4743-a7f3-faf695ae0c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:34.949553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d08ea-4781-4743-a7f3-faf695ae0c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:34.958804 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d08ea-4781-4743-a7f3-faf695ae0c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:34.960276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d08ea-4781-4743-a7f3-faf695ae0c9c service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:34.969867 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1319/2654] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:34.992953 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b6fa-b0dc-484d-8859-83f40086196c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:35.060252 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b6fa-b0dc-484d-8859-83f40086196c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:35.065713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:35.066342 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:35.066629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:35.066888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] PATH_INFO: `/v3/users/e8c1b4c519814d24b9ce94390caa376f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:35.068054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c1b4c519814d24b9ce94390caa376f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:35.070002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:35.124018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c1b4c519814d24b9ce94390caa376f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.128941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:35.136432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c1b4c519814d24b9ce94390caa376f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.151303 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c1b4c519814d24b9ce94390caa376f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.152044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c1b4c519814d24b9ce94390caa376f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.152670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c1b4c519814d24b9ce94390caa376f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.166781 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1336/2655] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:34 2022] DELETE /identity/v3/users/e8c1b4c519814d24b9ce94390caa376f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:35.171921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:35.172219 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:35.172500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:35.193358 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:35.194611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:35.254625 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1320/2656] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:35.267142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:35.268591 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:35.328557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb33a6d-9e2b-4d07-9732-84aa79e6866a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:35.332920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859925-a1ce-42f8-a98a-c53b7b388544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:35.333558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859925-a1ce-42f8-a98a-c53b7b388544 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:35.333835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859925-a1ce-42f8-a98a-c53b7b388544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:35.334131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859925-a1ce-42f8-a98a-c53b7b388544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:35.344526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859925-a1ce-42f8-a98a-c53b7b388544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:35.345965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859925-a1ce-42f8-a98a-c53b7b388544 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:35.356234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1337/2657] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:35.763659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:35.769100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:35.785045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f975119-e662-4828-bed8-1485bd1fc9b8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:35.792508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:35.793563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:35.793888 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:35.794582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] PATH_INFO: `/v3/projects/faa579bb88e34167853bed348131e4c2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:35.796537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa579bb88e34167853bed348131e4c2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:35.798827 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:35.853998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa579bb88e34167853bed348131e4c2', 'request_id': 'req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.860594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa579bb88e34167853bed348131e4c2', 'request_id': 'req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.870646 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa579bb88e34167853bed348131e4c2', 'request_id': 'req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.883661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] The token cache is being invalidate because project faa579bb88e34167853bed348131e4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:35.883956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.884711 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:35.886329 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1321/2658] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:35 2022] DELETE /identity/v3/projects/faa579bb88e34167853bed348131e4c2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:39:35.891814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5a8f1-5dc6-4225-81ec-0cb1f9457d25 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:35.892098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5a8f1-5dc6-4225-81ec-0cb1f9457d25 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:35.892377 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5a8f1-5dc6-4225-81ec-0cb1f9457d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:35.911987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-25d5a8f1-5dc6-4225-81ec-0cb1f9457d25 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:35.913190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-25d5a8f1-5dc6-4225-81ec-0cb1f9457d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:35.952531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:35.954690 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:35.965078 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:35.975319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1338/2659] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:35.983033 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c7f6-5823-436b-a461-8750d240a320 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:35.983321 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c7f6-5823-436b-a461-8750d240a320 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:35.983622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c7f6-5823-436b-a461-8750d240a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.003355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d4c6c7f6-5823-436b-a461-8750d240a320 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:36.004614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d4c6c7f6-5823-436b-a461-8750d240a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.013269 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1339/2660] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:36.018268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c7f6-5823-436b-a461-8750d240a320 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.026307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0fdf2-af9d-4927-b0a3-33f5ec7af27e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.027082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c7f6-5823-436b-a461-8750d240a320 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.030903 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.031689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.031915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.032016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.032260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] PATH_INFO: `/v3/users/5fd00a1ef41e4130a5c640ea41cf4cff` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.032376 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.032577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.032856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.033399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd00a1ef41e4130a5c640ea41cf4cff)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.033513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:36.033823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.035362 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.035721 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.047570 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1340/2661] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:39:36.051788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.061298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6d79f-6773-482d-9449-9bb1b72c53fe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.066628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.067231 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.067504 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.067779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.068401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.070327 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.093173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd00a1ef41e4130a5c640ea41cf4cff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.103066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd00a1ef41e4130a5c640ea41cf4cff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.103688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd00a1ef41e4130a5c640ea41cf4cff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.104071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1341/2662] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:36 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:36.111437 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.118611 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd00a1ef41e4130a5c640ea41cf4cff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.119406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6263abc1-e64f-4cfb-9b4d-42117f268125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd00a1ef41e4130a5c640ea41cf4cff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.131650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1322/2663] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:35 2022] DELETE /identity/v3/users/5fd00a1ef41e4130a5c640ea41cf4cff => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:36.135958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.136248 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.136584 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.150922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:36.156242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:36.157525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.189690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec4fb2-f1b9-4f4d-bed2-cd10689c4816 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.222399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1323/2664] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:36.232189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.233755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.251149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.251863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.252214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.252551 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.253273 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.255301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.266837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:36.278660 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1342/2665] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:36 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:36.282903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.285128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.296574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc594b-6de9-4fd9-bc00-75d3b2e0b38f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.297867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f43d81-eeea-4358-bb64-3b680f4ccd21 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.300768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.301410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.301786 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.302094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.303433 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.304134 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.304503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.304856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.305659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.307333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.312650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.314238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.319120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1343/2666] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:36.322780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.325753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1324/2667] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:36.333710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03932-5f1f-4b4a-8bfd-42e6c5768885 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.339229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83fda5-60c9-46f5-a1d5-c09078291ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.339951 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83fda5-60c9-46f5-a1d5-c09078291ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.340292 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83fda5-60c9-46f5-a1d5-c09078291ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.340696 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83fda5-60c9-46f5-a1d5-c09078291ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.341416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83fda5-60c9-46f5-a1d5-c09078291ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.343142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83fda5-60c9-46f5-a1d5-c09078291ae7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.361598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1344/2668] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:36.362434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.375202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6dd1-438d-47ee-9000-374d614ca3de service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.380733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faae9a4-40c8-40a6-925d-eda86ccaf19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.381441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae9a4-40c8-40a6-925d-eda86ccaf19d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.382279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae9a4-40c8-40a6-925d-eda86ccaf19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.382568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae9a4-40c8-40a6-925d-eda86ccaf19d admin admin] PATH_INFO: `/v3/projects/0400d59a2e3141b79958bc30f3205412/users/30f6b043cf26479c97207aebc7e5b7c6/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.403663 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faae9a4-40c8-40a6-925d-eda86ccaf19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0400d59a2e3141b79958bc30f3205412, user_id=30f6b043cf26479c97207aebc7e5b7c6, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.408279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faae9a4-40c8-40a6-925d-eda86ccaf19d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.433387 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1325/2669] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:36 2022] PUT /identity/v3/projects/0400d59a2e3141b79958bc30f3205412/users/30f6b043cf26479c97207aebc7e5b7c6/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:36.448147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.448589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.449109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.494065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] MFA Rules not processed for user `30f6b043cf26479c97207aebc7e5b7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:36.496150 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.548709 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.550301 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.550768 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.578105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1345/2670] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:36.588094 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:36.589626 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.589945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.593138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.656178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1326/2671] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:39:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:36.664356 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:36.690890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d8206-d812-4e4e-b444-91437edcb08d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.695931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.696122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.696366 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.696637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.704494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.705994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.720404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.721669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.734302 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1346/2672] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:36.742460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.743902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:36.782009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741709a-7727-429f-9da1-2a1836780f12 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.795414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.796932 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.797072 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.797286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] PATH_INFO: `/v3/projects/415c4aacdedc44e5b8f2b5e69736646f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.801943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415c4aacdedc44e5b8f2b5e69736646f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.805406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.846265 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d79e1-31a0-4201-a452-3ea8308738d8 service glance] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:36.858297 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:36.858962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:36.862528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:36.862842 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:36.876671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:36.880485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:36.886902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415c4aacdedc44e5b8f2b5e69736646f', 'request_id': 'req-d010f314-d40c-4100-95bc-2a344697f451'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.902460 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415c4aacdedc44e5b8f2b5e69736646f', 'request_id': 'req-d010f314-d40c-4100-95bc-2a344697f451'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.913706 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1347/2673] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:39:36.918715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:36.935364 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415c4aacdedc44e5b8f2b5e69736646f', 'request_id': 'req-d010f314-d40c-4100-95bc-2a344697f451'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.975631 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] The token cache is being invalidate because project 415c4aacdedc44e5b8f2b5e69736646f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:36.975924 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.980179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:36.982234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1327/2674] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:36 2022] DELETE /identity/v3/projects/415c4aacdedc44e5b8f2b5e69736646f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:36.986329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:36.999501 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a9da7-f593-470a-8b57-5d71af6136f7 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:37.085659 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:37.086653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:37.087133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:37.087628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] PATH_INFO: `/v3/users/05e4a8740b7f4c77a95fdb3e5f29d5ed` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:37.088908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e4a8740b7f4c77a95fdb3e5f29d5ed)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:37.090889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:37.163329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e4a8740b7f4c77a95fdb3e5f29d5ed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.176637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e4a8740b7f4c77a95fdb3e5f29d5ed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.192880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:37.194802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e4a8740b7f4c77a95fdb3e5f29d5ed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.195684 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e4a8740b7f4c77a95fdb3e5f29d5ed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.196374 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2daef8fe-f4a7-4627-9f6a-fc536a297e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e4a8740b7f4c77a95fdb3e5f29d5ed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.222488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1348/2675] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:36 2022] DELETE /identity/v3/users/05e4a8740b7f4c77a95fdb3e5f29d5ed => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:37.593996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:37.595521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:37.633497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f314-d40c-4100-95bc-2a344697f451 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:37.717262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:37.717817 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:37.718118 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:37.718396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] PATH_INFO: `/v3/projects/7c04cd5feddc46c68484f8fbd97c2ed7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:37.719578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c04cd5feddc46c68484f8fbd97c2ed7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:37.721641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:37.778007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c04cd5feddc46c68484f8fbd97c2ed7', 'request_id': 'req-b186060a-d9ca-4b71-9b18-c6a348e3b06a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.785242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c04cd5feddc46c68484f8fbd97c2ed7', 'request_id': 'req-b186060a-d9ca-4b71-9b18-c6a348e3b06a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.797497 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c04cd5feddc46c68484f8fbd97c2ed7', 'request_id': 'req-b186060a-d9ca-4b71-9b18-c6a348e3b06a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.811151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] The token cache is being invalidate because project 7c04cd5feddc46c68484f8fbd97c2ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:37.812220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.813024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:37.814883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1328/2676] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:37 2022] DELETE /identity/v3/projects/7c04cd5feddc46c68484f8fbd97c2ed7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:37.822620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82393487-d2c4-49e6-ae00-348700ba8671 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:37.823189 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82393487-d2c4-49e6-ae00-348700ba8671 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:37.824471 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82393487-d2c4-49e6-ae00-348700ba8671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:37.852461 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82393487-d2c4-49e6-ae00-348700ba8671 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:37.854488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82393487-d2c4-49e6-ae00-348700ba8671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:37.932942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:37.934993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:37.963714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1349/2677] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:37.974441 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c11fae-11b9-4a37-acca-11f416ba5c04 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:37.975044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c11fae-11b9-4a37-acca-11f416ba5c04 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:37.976177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c11fae-11b9-4a37-acca-11f416ba5c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:37.999908 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-40c11fae-11b9-4a37-acca-11f416ba5c04 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:38.001503 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40c11fae-11b9-4a37-acca-11f416ba5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:38.015155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1350/2678] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:38.019255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c11fae-11b9-4a37-acca-11f416ba5c04 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.041988 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c11fae-11b9-4a37-acca-11f416ba5c04 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.048389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.049489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.049793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186060a-d9ca-4b71-9b18-c6a348e3b06a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.049916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.050340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.051105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:38.051576 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.053360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.053505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.061053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.061346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.062033 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.070491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:38.073743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1351/2679] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:39:38.081490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.098057 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.100290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.101583 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b956b-1075-46ab-84bb-99949afbf3fe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.114016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1329/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:38.117858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.117858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.117858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.117858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.119146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.121967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.168793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1352/2681] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:38 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:38.173307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.191337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef684290-d788-4af1-aedc-89ab2fae98dc service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.212605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:38.310402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.311166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.311949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.312467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.313239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.317037 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.369745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1330/2682] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:38 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:38.377446 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.398401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ed8c-5dfd-470c-98b1-89175f6dfbdf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.407416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.407938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.408383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.408758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.409599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.411691 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.449558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1353/2683] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:39:38.453802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.468207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5be339-00e7-4f3e-8ae5-f7e02eff5a7c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.480430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2a5c-bd4e-4fc5-9fbc-4b2920e0b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.481062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2a5c-bd4e-4fc5-9fbc-4b2920e0b69b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.481340 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2a5c-bd4e-4fc5-9fbc-4b2920e0b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.481637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2a5c-bd4e-4fc5-9fbc-4b2920e0b69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.482293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f2a5c-bd4e-4fc5-9fbc-4b2920e0b69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.484681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f2a5c-bd4e-4fc5-9fbc-4b2920e0b69b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.507802 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.508493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1331/2684] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:38.526111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ad54c-4b6d-4a1f-95e1-d6b2d9a20778 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.537565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.541870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.542264 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.542785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] PATH_INFO: `/v3/projects/b1baccd19a294244a48fdf056d4ca597/users/cb445433811d4f8a91eea8bcd0dced39/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.575692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1baccd19a294244a48fdf056d4ca597, user_id=cb445433811d4f8a91eea8bcd0dced39, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.579544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.605452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1354/2685] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:38 2022] PUT /identity/v3/projects/b1baccd19a294244a48fdf056d4ca597/users/cb445433811d4f8a91eea8bcd0dced39/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:38.610596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.611025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.611302 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.658955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:38.671065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:38.737490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1332/2686] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:38.745187 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.747201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:38.753357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:38.753357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:38.885472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644be9f-5b92-4483-ac85-5ad66fb13beb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.893300 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3223a03-9944-4134-8c24-1095747203a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.894896 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3223a03-9944-4134-8c24-1095747203a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.899739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3223a03-9944-4134-8c24-1095747203a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.900044 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3223a03-9944-4134-8c24-1095747203a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.910931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3223a03-9944-4134-8c24-1095747203a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.915696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c27d3b-38db-47e8-8420-260d485bf120 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:38.922086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3223a03-9944-4134-8c24-1095747203a2 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.940228 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:38.941177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:38.941660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:38.942080 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:38.945596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:38.955493 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1355/2687] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:38.976348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:38.978467 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:38.996805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1333/2688] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:45.015313 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7897-0094-4c7d-8652-1cde69020590 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:45.015914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7897-0094-4c7d-8652-1cde69020590 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:45.015914 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7897-0094-4c7d-8652-1cde69020590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:45.080002 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:45.084634 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3e0a7897-0094-4c7d-8652-1cde69020590 None None] MFA Rules not processed for user `cb445433811d4f8a91eea8bcd0dced39`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:45.086263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e0a7897-0094-4c7d-8652-1cde69020590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:45.191351 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1356/2689] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:45.191989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:45.206910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b672e-9730-4f2d-bddd-cec941b00382 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:45.217141 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:45.217806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:45.218126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:45.218426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:45.219132 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:45.221009 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:45.276982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:45.299953 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1334/2690] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:45 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:45.304428 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7897-0094-4c7d-8652-1cde69020590 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:45.320263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7897-0094-4c7d-8652-1cde69020590 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:45.462158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:45.462818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:45.463088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:45.463360 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:45.463998 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:45.465971 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:45.529818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1357/2691] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:45 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:45.538197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:45.549749 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71669a27-dd2a-458b-8082-14ba25e3de82 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:45.555103 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:45.555733 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:45.556012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:45.556285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:45.557047 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:45.558705 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:45.574066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1335/2692] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:45.575256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:45.589741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fa264-db15-4ab7-8107-d84f7a6436d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:45.596690 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:45.597683 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:45.598135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:45.598649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] PATH_INFO: `/v3/projects/e97a9ed424f34ae48f5200fa985f1fc8/users/ab8d56aeb00c45abb87a631e224236f8/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:45.624037 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97a9ed424f34ae48f5200fa985f1fc8, user_id=ab8d56aeb00c45abb87a631e224236f8, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:45.628429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:45.653411 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1358/2693] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:45 2022] PUT /identity/v3/projects/e97a9ed424f34ae48f5200fa985f1fc8/users/ab8d56aeb00c45abb87a631e224236f8/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:45.654621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:45.669758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edfee-825b-4410-905c-4c4e6a6f4293 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:45.763576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3abcb3-1733-4d2b-b531-9e15d58cfedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:45.764335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3abcb3-1733-4d2b-b531-9e15d58cfedd admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:45.764677 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3abcb3-1733-4d2b-b531-9e15d58cfedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:45.765480 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3abcb3-1733-4d2b-b531-9e15d58cfedd admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:45.769235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3abcb3-1733-4d2b-b531-9e15d58cfedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:45.770954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3abcb3-1733-4d2b-b531-9e15d58cfedd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:45.800994 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1336/2694] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:45.806780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:45.820001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1089f70-d3e5-4ee7-b8b7-e74938b4d0e7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:45.824999 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:45.825724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:45.826794 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:45.827086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] PATH_INFO: `/v3/projects/e97a9ed424f34ae48f5200fa985f1fc8/users/ab8d56aeb00c45abb87a631e224236f8/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:45.829685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97a9ed424f34ae48f5200fa985f1fc8, user_id=ab8d56aeb00c45abb87a631e224236f8, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:45.832860 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:45.852256 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1359/2695] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:45 2022] PUT /identity/v3/projects/e97a9ed424f34ae48f5200fa985f1fc8/users/ab8d56aeb00c45abb87a631e224236f8/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:51.684404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:51.684967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:51.684967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:51.713952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] MFA Rules not processed for user `ab8d56aeb00c45abb87a631e224236f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:51.715176 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:51.784439 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1337/2696] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:51.798697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:51.857719 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:51.875996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ad93-e046-4188-a541-058b5dc8382f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:51.881888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41757a9-2d28-4eaa-882c-1d8dcc97b58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:51.882500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41757a9-2d28-4eaa-882c-1d8dcc97b58e service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:51.882773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41757a9-2d28-4eaa-882c-1d8dcc97b58e service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:51.883035 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41757a9-2d28-4eaa-882c-1d8dcc97b58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:51.952422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41757a9-2d28-4eaa-882c-1d8dcc97b58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:51.954067 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41757a9-2d28-4eaa-882c-1d8dcc97b58e service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:51.963161 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1360/2697] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:52.259511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:52.267853 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:52.347290 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dda4d-28e7-4b38-9ca0-24229ad0402e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:52.354305 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:52.355100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:52.355531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:52.355874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] PATH_INFO: `/v3/users/30f6b043cf26479c97207aebc7e5b7c6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:52.357272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f6b043cf26479c97207aebc7e5b7c6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:52.359717 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:52.372040 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:52.424551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f6b043cf26479c97207aebc7e5b7c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:52.442430 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f6b043cf26479c97207aebc7e5b7c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:52.446171 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f6b043cf26479c97207aebc7e5b7c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:52.462503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f6b043cf26479c97207aebc7e5b7c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:52.463236 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f6b043cf26479c97207aebc7e5b7c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:52.477449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1338/2698] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:52 2022] DELETE /identity/v3/users/30f6b043cf26479c97207aebc7e5b7c6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:52.481449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:52.481695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:52.481992 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:52.509469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:52.510288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:52.581408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1361/2699] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:52.589987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:52.591575 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:52.660938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6a72-8a40-4a53-b129-b18a2cbfb0de admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:52.665699 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f170f-b23f-4ea8-a64d-73e009395552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:52.666411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f170f-b23f-4ea8-a64d-73e009395552 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:52.666753 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f170f-b23f-4ea8-a64d-73e009395552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:52.667085 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f170f-b23f-4ea8-a64d-73e009395552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:52.677669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f170f-b23f-4ea8-a64d-73e009395552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:52.679380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f170f-b23f-4ea8-a64d-73e009395552 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:52.691013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1339/2700] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:53.136697 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:53.139310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:53.157979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383550ae-2443-414a-bdf4-cd9a8702a6e0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:53.164674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:53.165943 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.166382 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.167588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] PATH_INFO: `/v3/projects/0400d59a2e3141b79958bc30f3205412` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.169394 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0400d59a2e3141b79958bc30f3205412)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:53.172468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:53.241676 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0400d59a2e3141b79958bc30f3205412', 'request_id': 'req-48c85d62-450a-42cd-a552-fdcd859eafa2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:53.249326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0400d59a2e3141b79958bc30f3205412', 'request_id': 'req-48c85d62-450a-42cd-a552-fdcd859eafa2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:53.262921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0400d59a2e3141b79958bc30f3205412', 'request_id': 'req-48c85d62-450a-42cd-a552-fdcd859eafa2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:53.282693 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] The token cache is being invalidate because project 0400d59a2e3141b79958bc30f3205412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:53.283001 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:53.283755 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48c85d62-450a-42cd-a552-fdcd859eafa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:53.288968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1362/2701] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:53 2022] DELETE /identity/v3/projects/0400d59a2e3141b79958bc30f3205412 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:53.291427 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17ce7-c69b-475c-a636-386b5dbc679a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.291806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17ce7-c69b-475c-a636-386b5dbc679a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.292328 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17ce7-c69b-475c-a636-386b5dbc679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.322117 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6ec17ce7-c69b-475c-a636-386b5dbc679a None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:53.323645 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6ec17ce7-c69b-475c-a636-386b5dbc679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:53.435088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1340/2702] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:53.446070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c66f-222e-435b-a401-8e7f7d9e2e70 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.446365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c66f-222e-435b-a401-8e7f7d9e2e70 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.446650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c66f-222e-435b-a401-8e7f7d9e2e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.490041 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d073-b541-418f-baf7-a20ba1e85930 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.490679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d073-b541-418f-baf7-a20ba1e85930 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.491086 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d073-b541-418f-baf7-a20ba1e85930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.518763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5c65c66f-222e-435b-a401-8e7f7d9e2e70 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:53.519892 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b600d073-b541-418f-baf7-a20ba1e85930 None None] MFA Rules not processed for user `cb445433811d4f8a91eea8bcd0dced39`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:53.521387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5c65c66f-222e-435b-a401-8e7f7d9e2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:53.522679 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b600d073-b541-418f-baf7-a20ba1e85930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:53.535190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1363/2703] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:53.539779 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c66f-222e-435b-a401-8e7f7d9e2e70 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:53.549442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c66f-222e-435b-a401-8e7f7d9e2e70 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:53.554705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:53.555339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.555616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.555889 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.556902 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:53.557211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:53.559048 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:53.562421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:53.568522 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:53.574172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1364/2704] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:39:53.578672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:53.592911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a332-c39e-4195-947c-5ab944779b78 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:53.598746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:53.599373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.599652 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.599922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.600562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:53.602528 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:53.627052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1341/2705] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:53.641456 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1365/2706] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:53 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:53.645632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600d073-b541-418f-baf7-a20ba1e85930 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:53.659621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600d073-b541-418f-baf7-a20ba1e85930 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:53.750231 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:53.750957 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.751125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.751701 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.752608 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:53.754565 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:53.782997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1342/2707] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:53 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:53.787338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:53.798600 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82dc3-ff9e-4963-8b9e-140606e4cf0b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:53.803825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:53.804670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.804901 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.805004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.805653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:53.807260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:53.820725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1366/2708] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:53.825183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:53.836281 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75339-b0e9-487d-a00b-80fe90780036 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:53.841252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9207981-5eea-4a77-b38d-b1c30fe2bd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:53.841987 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207981-5eea-4a77-b38d-b1c30fe2bd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.842320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207981-5eea-4a77-b38d-b1c30fe2bd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.842508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207981-5eea-4a77-b38d-b1c30fe2bd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.843558 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9207981-5eea-4a77-b38d-b1c30fe2bd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:53.845262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9207981-5eea-4a77-b38d-b1c30fe2bd04 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:53.858410 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1343/2709] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:53.862822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:53.873476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e265f8-9bcb-439f-be44-263d4e6d3a04 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:53.878996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:53.879769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.880136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.880466 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] PATH_INFO: `/v3/projects/029d0e58b58a49c9af5030adca30ee0e/users/33b777e294c54bc29eb83d02ccbafebb/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.897818 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029d0e58b58a49c9af5030adca30ee0e, user_id=33b777e294c54bc29eb83d02ccbafebb, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:53.900831 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:53.919032 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1367/2710] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:53 2022] PUT /identity/v3/projects/029d0e58b58a49c9af5030adca30ee0e/users/33b777e294c54bc29eb83d02ccbafebb/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:53.930251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce71e8-3101-4c57-9a20-37c98d00b16c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:53.930606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce71e8-3101-4c57-9a20-37c98d00b16c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:53.931032 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce71e8-3101-4c57-9a20-37c98d00b16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:53.963871 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f8ce71e8-3101-4c57-9a20-37c98d00b16c None None] MFA Rules not processed for user `33b777e294c54bc29eb83d02ccbafebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:53.965206 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f8ce71e8-3101-4c57-9a20-37c98d00b16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.070247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1344/2711] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:54.087838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:54.090085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.172286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef91aa2-1890-4840-8f63-facd311cbfa1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:54.189759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:54.189759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.189759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.189759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.190188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:54.190188 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:54.201004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1368/2712] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:54.226408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce71e8-3101-4c57-9a20-37c98d00b16c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:54.289235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:54.309404 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce71e8-3101-4c57-9a20-37c98d00b16c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:54.312533 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:54.314128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.315019 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:54.316070 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.316682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.317024 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] PATH_INFO: `/v3/users/33b777e294c54bc29eb83d02ccbafebb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.318376 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b777e294c54bc29eb83d02ccbafebb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:54.321119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:54.374967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b777e294c54bc29eb83d02ccbafebb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:54.378517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a3b23-6e02-4523-9d06-fa581b8200e4 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:54.382715 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13812e7e-6b24-4599-9036-facf5424018e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:54.383398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13812e7e-6b24-4599-9036-facf5424018e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.383760 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13812e7e-6b24-4599-9036-facf5424018e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.384174 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13812e7e-6b24-4599-9036-facf5424018e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.384776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b777e294c54bc29eb83d02ccbafebb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:54.386239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13812e7e-6b24-4599-9036-facf5424018e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.386457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b777e294c54bc29eb83d02ccbafebb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:54.397878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13812e7e-6b24-4599-9036-facf5424018e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:54.399318 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13812e7e-6b24-4599-9036-facf5424018e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:54.401873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b777e294c54bc29eb83d02ccbafebb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:54.402652 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b777e294c54bc29eb83d02ccbafebb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:54.408581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1369/2713] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:54.424500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1345/2714] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:39:54 2022] DELETE /identity/v3/users/33b777e294c54bc29eb83d02ccbafebb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:54.429644 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bd92c-a5a2-4713-b214-4882d27aa5bf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.430049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bd92c-a5a2-4713-b214-4882d27aa5bf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.430375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bd92c-a5a2-4713-b214-4882d27aa5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.450922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-734bd92c-a5a2-4713-b214-4882d27aa5bf None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:54.452491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-734bd92c-a5a2-4713-b214-4882d27aa5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.508224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:54.551108 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1370/2715] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:54.558352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:54.560091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.576858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f3ede-15f1-4391-927d-f49e0f776f7e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.577270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f3ede-15f1-4391-927d-f49e0f776f7e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.578330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f3ede-15f1-4391-927d-f49e0f776f7e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.579962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1371/2716] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:39:54.588299 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f838d8b-4fd5-4177-9158-4db3de4a1a9e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.588714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f838d8b-4fd5-4177-9158-4db3de4a1a9e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.588888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f838d8b-4fd5-4177-9158-4db3de4a1a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.613619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6f838d8b-4fd5-4177-9158-4db3de4a1a9e None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:54.614927 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f838d8b-4fd5-4177-9158-4db3de4a1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.666820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee41dd-5653-42b5-b1ad-954af65cce9f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:54.671147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:54.671917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.672292 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.672656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.689553 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:54.692278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:54.703898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1346/2717] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:54.733871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1372/2718] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:39:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:54.747442 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:54.748874 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.816832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e0151-eb84-4c11-85d3-0ddaefe65d46 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:54.820669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937431a1-7abe-4ae7-9370-3fe0ebf43d71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:54.821298 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937431a1-7abe-4ae7-9370-3fe0ebf43d71 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.821605 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937431a1-7abe-4ae7-9370-3fe0ebf43d71 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.821880 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937431a1-7abe-4ae7-9370-3fe0ebf43d71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.833503 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937431a1-7abe-4ae7-9370-3fe0ebf43d71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:54.835238 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937431a1-7abe-4ae7-9370-3fe0ebf43d71 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:54.847590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1347/2719] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:54.932963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e45895-0c8d-4d96-8179-964366f37aba None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.939110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e45895-0c8d-4d96-8179-964366f37aba None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.940233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e45895-0c8d-4d96-8179-964366f37aba None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.942487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1373/2720] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:39:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:39:54.948335 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:54.948628 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:54.949031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:54.976838 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] MFA Rules not processed for user `64c5c41465004c0a81fced6e8834a5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:54.978215 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:54.986183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1348/2721] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:39:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:54.999556 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e45895-0c8d-4d96-8179-964366f37aba None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.013402 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e45895-0c8d-4d96-8179-964366f37aba None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.017343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a5ea2-12e3-4c40-bc84-fe78bd7cf515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.018163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5ea2-12e3-4c40-bc84-fe78bd7cf515 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.018500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5ea2-12e3-4c40-bc84-fe78bd7cf515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.018832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5ea2-12e3-4c40-bc84-fe78bd7cf515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.032887 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a5ea2-12e3-4c40-bc84-fe78bd7cf515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.034496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a5ea2-12e3-4c40-bc84-fe78bd7cf515 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.043124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1374/2722] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:55.055431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.058849 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.070295 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:55.086992 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1dea2-9b29-4fd7-a9df-9579b8378eac None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.095895 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.096563 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.096845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.097123 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] PATH_INFO: `/v3/projects/029d0e58b58a49c9af5030adca30ee0e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.098910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029d0e58b58a49c9af5030adca30ee0e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.100980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.151080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf53f37-f462-4e97-a529-afb1822ebf2a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.151747 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf53f37-f462-4e97-a529-afb1822ebf2a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.152180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf53f37-f462-4e97-a529-afb1822ebf2a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.154142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1375/2723] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:39:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:39:55.168034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.168633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.169436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.177658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029d0e58b58a49c9af5030adca30ee0e', 'request_id': 'req-38d3d3c5-0739-47b2-97b5-a85e9b645239'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:55.189346 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029d0e58b58a49c9af5030adca30ee0e', 'request_id': 'req-38d3d3c5-0739-47b2-97b5-a85e9b645239'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:55.196011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:55.197413 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.201876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029d0e58b58a49c9af5030adca30ee0e', 'request_id': 'req-38d3d3c5-0739-47b2-97b5-a85e9b645239'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:55.214747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] The token cache is being invalidate because project 029d0e58b58a49c9af5030adca30ee0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:39:55.214966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:55.215621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-38d3d3c5-0739-47b2-97b5-a85e9b645239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:39:55.217135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1349/2724] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:39:55 2022] DELETE /identity/v3/projects/029d0e58b58a49c9af5030adca30ee0e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:55.222911 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de618b8-1bdf-4ea0-99c1-704f1368a2c2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.223255 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de618b8-1bdf-4ea0-99c1-704f1368a2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.223534 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de618b8-1bdf-4ea0-99c1-704f1368a2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.243807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9de618b8-1bdf-4ea0-99c1-704f1368a2c2 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:55.245279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9de618b8-1bdf-4ea0-99c1-704f1368a2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.271588 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1376/2725] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:39:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:55.284734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.286240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.321304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1350/2726] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:55.330641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c9dd-3d8e-4510-82b0-b04c244c1100 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.331444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c9dd-3d8e-4510-82b0-b04c244c1100 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.331727 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c9dd-3d8e-4510-82b0-b04c244c1100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.353650 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764238f-0d30-4000-9e14-b8967c5d5199 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.353961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0d53c9dd-3d8e-4510-82b0-b04c244c1100 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:55.355216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0d53c9dd-3d8e-4510-82b0-b04c244c1100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.357338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.358009 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.358358 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.358815 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.363269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1351/2727] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:55.368253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c9dd-3d8e-4510-82b0-b04c244c1100 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.371185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.372820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.377459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c9dd-3d8e-4510-82b0-b04c244c1100 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.378375 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:55.382369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.382977 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.383258 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.383531 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.384185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:39:55.384486 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.386047 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1377/2728] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:55.389540 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.402848 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1352/2729] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:39:55.407769 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.419082 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8e8ce-8b70-4269-ad00-62169b731a56 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.424490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.425119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.425419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.425695 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.426337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.428307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.454650 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.456657 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.461423 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1378/2730] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:39:55 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:39:55.465627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.533165 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b93ef-449f-49ef-9eaf-1f82e8da76a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.535405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a95593-2b81-4fae-bf65-2ace6cb469a7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.538144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.538790 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.539069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.539440 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.539994 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.541824 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:55.542042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.569416 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1379/2731] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:39:55 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:39:55.570963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.581220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c2511-87d9-41dc-a766-60264cb92605 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.586026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.586743 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.587092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.587468 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.588230 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.590192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.604661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1380/2732] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:55.605764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.612956 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d966a68-3a2d-475c-bb3f-630787dffc95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.613965 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966a68-3a2d-475c-bb3f-630787dffc95 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.614223 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966a68-3a2d-475c-bb3f-630787dffc95 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.614638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966a68-3a2d-475c-bb3f-630787dffc95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.615838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03c249-708b-4dc3-8f7b-9c686eaf3069 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.621475 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9d966a68-3a2d-475c-bb3f-630787dffc95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.623799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.624661 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.624987 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.625340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.626092 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.627776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.637898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d966a68-3a2d-475c-bb3f-630787dffc95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.642324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1381/2733] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:39:55.642481 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d966a68-3a2d-475c-bb3f-630787dffc95 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.643385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.651064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1353/2734] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:39:55.655557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ca21-767e-4d46-8cc8-6e58180f2a30 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.660432 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.661148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.661453 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.661727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] PATH_INFO: `/v3/projects/242232590ee44ae3b98da62cb0d16e3a/users/ef78d542764f4718be565916ef8c3c99/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.678548 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=242232590ee44ae3b98da62cb0d16e3a, user_id=ef78d542764f4718be565916ef8c3c99, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.681869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.696848 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1382/2735] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:39:55 2022] PUT /identity/v3/projects/242232590ee44ae3b98da62cb0d16e3a/users/ef78d542764f4718be565916ef8c3c99/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:55.708380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf815-b834-453b-8d40-cfad52dad08b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.708664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf815-b834-453b-8d40-cfad52dad08b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.708946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf815-b834-453b-8d40-cfad52dad08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.741680 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b2abf815-b834-453b-8d40-cfad52dad08b None None] MFA Rules not processed for user `ef78d542764f4718be565916ef8c3c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:55.742996 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b2abf815-b834-453b-8d40-cfad52dad08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.825596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1354/2736] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:39:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:39:55.839454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:55.841283 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:55.925589 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9103-ce77-43bf-bfa9-dea64d23d0bc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:55.930481 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:55.931112 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:55.934717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:55.935019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:55.946497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:55.948215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:55.960636 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1383/2737] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:39:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:39:58.007943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7185-a7cc-4c09-a7a5-3b08a8235817 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:58.008465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7185-a7cc-4c09-a7a5-3b08a8235817 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:58.008465 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7185-a7cc-4c09-a7a5-3b08a8235817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:58.034769 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1f3d7185-a7cc-4c09-a7a5-3b08a8235817 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:39:58.036116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1f3d7185-a7cc-4c09-a7a5-3b08a8235817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:58.100929 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1355/2738] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:39:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:39:58.117014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:39:58.118599 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:39:58.146983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:58.195890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a445c3-2e35-4cbe-ad62-f6cdeeec32f5 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:39:58.202617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941299-ba41-4163-867e-6cb509911e36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:39:58.203492 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941299-ba41-4163-867e-6cb509911e36 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:39:58.203773 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941299-ba41-4163-867e-6cb509911e36 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:39:58.204024 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941299-ba41-4163-867e-6cb509911e36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:39:58.213654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941299-ba41-4163-867e-6cb509911e36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:39:58.215245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941299-ba41-4163-867e-6cb509911e36 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:39:58.226737 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1384/2739] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:39:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:40:06.724288 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7185-a7cc-4c09-a7a5-3b08a8235817 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:40:06.762067 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:06.803199 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7185-a7cc-4c09-a7a5-3b08a8235817 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:40:06.809746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:40:06.810695 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:06.811569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:06.811850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] PATH_INFO: `/v3/users/ef78d542764f4718be565916ef8c3c99` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:06.813533 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef78d542764f4718be565916ef8c3c99)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:40:06.816742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:40:06.870150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef78d542764f4718be565916ef8c3c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:06.878943 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef78d542764f4718be565916ef8c3c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:06.879569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef78d542764f4718be565916ef8c3c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:06.892136 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef78d542764f4718be565916ef8c3c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:06.892805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef78d542764f4718be565916ef8c3c99'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:06.909189 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1356/2740] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:40:06 2022] DELETE /identity/v3/users/ef78d542764f4718be565916ef8c3c99 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:40:06.918039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:06.918039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:06.918039 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:06.936362 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:40:06.937714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:07.010847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1385/2741] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:40:07.023175 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:40:07.024887 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:07.090237 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ffa94-4f14-4a63-b65e-ecc82d5527b4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:40:07.094767 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:40:07.095390 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:07.095667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:07.095941 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:07.105275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:40:07.106765 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:40:07.116940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1357/2742] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:40:07.336757 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:40:07.338752 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:07.354475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0c038-a664-462f-8bb1-29194b1704fe None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:40:07.360019 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede81506-a94a-489d-a690-f59de79cebd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:40:07.361247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81506-a94a-489d-a690-f59de79cebd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:07.361247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81506-a94a-489d-a690-f59de79cebd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:07.361247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81506-a94a-489d-a690-f59de79cebd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:07.363088 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ede81506-a94a-489d-a690-f59de79cebd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:07.373294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede81506-a94a-489d-a690-f59de79cebd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:40:07.374754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede81506-a94a-489d-a690-f59de79cebd0 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:40:07.382939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1386/2743] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:40:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:40:07.488234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:40:07.489889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:07.507106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f406-9ff8-4ac3-bdae-0703cb2f5979 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:40:07.514656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:40:07.515324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:07.515708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:07.515989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] PATH_INFO: `/v3/projects/242232590ee44ae3b98da62cb0d16e3a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:07.517279 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242232590ee44ae3b98da62cb0d16e3a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:40:07.519459 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:40:07.572877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242232590ee44ae3b98da62cb0d16e3a', 'request_id': 'req-4da33859-6986-4e56-99ef-5bc659e154b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:07.573978 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:07.579755 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242232590ee44ae3b98da62cb0d16e3a', 'request_id': 'req-4da33859-6986-4e56-99ef-5bc659e154b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:07.589083 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242232590ee44ae3b98da62cb0d16e3a', 'request_id': 'req-4da33859-6986-4e56-99ef-5bc659e154b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:07.600299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] The token cache is being invalidate because project 242232590ee44ae3b98da62cb0d16e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:40:07.600718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:07.601630 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:40:07.603150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1358/2744] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:40:07 2022] DELETE /identity/v3/projects/242232590ee44ae3b98da62cb0d16e3a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:40:13.567898 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:13.568383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:13.568500 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:13.589007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:40:13.590239 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:13.650526 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1387/2745] 10.222.0.25 () {58 vars in 967 bytes} [Mon Aug 8 02:40:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:40:13.664069 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:40:13.666385 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:13.746126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33859-6986-4e56-99ef-5bc659e154b3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:40:13.751623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d286055-bd8d-4b48-ad14-fb56513d7511 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:40:13.752235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286055-bd8d-4b48-ad14-fb56513d7511 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:13.752508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286055-bd8d-4b48-ad14-fb56513d7511 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:13.752770 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286055-bd8d-4b48-ad14-fb56513d7511 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:13.761062 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d286055-bd8d-4b48-ad14-fb56513d7511 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:40:13.762667 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d286055-bd8d-4b48-ad14-fb56513d7511 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:40:13.770697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1359/2746] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:40:16.517249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:40:16.519596 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:16.572454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:16.584970 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b27de-15be-4fc6-93f3-d701c49e5ed9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:40:16.589527 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:40:16.590176 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:16.590452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:16.590710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:16.593350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:16.660003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:40:16.661489 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:40:16.671209 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1388/2747] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:40:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:40:23.767763 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=38,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:26.667018 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=30 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:54.820689 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7ade-3fcd-4f99-ab82-4e0d3b63dce5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:40:54.821285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7ade-3fcd-4f99-ab82-4e0d3b63dce5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:40:54.821285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7ade-3fcd-4f99-ab82-4e0d3b63dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:40:54.841809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2f3e7ade-3fcd-4f99-ab82-4e0d3b63dce5 None None] MFA Rules not processed for user `d7aec24c192f469dbc76a8e525f10497`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:40:54.843015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2f3e7ade-3fcd-4f99-ab82-4e0d3b63dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:40:54.917802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1360/2748] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:41:04.910710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=25 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:37.150462 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:41:37.152581 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:41:37.306065 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b2439-51de-455b-9f30-00e7bf49a883 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:41:37.314919 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:41:37.315850 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:41:37.316270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:41:37.316654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:41:37.319386 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:41:37.332904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:41:37.334513 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:41:37.344330 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1389/2749] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:41:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:41:47.340247 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=63 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:51.462405 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed46ff-6b6e-43ef-8897-f7a945881e9a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:41:51.462962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed46ff-6b6e-43ef-8897-f7a945881e9a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:41:51.462962 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed46ff-6b6e-43ef-8897-f7a945881e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:41:51.494820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-99ed46ff-6b6e-43ef-8897-f7a945881e9a None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:41:51.496029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99ed46ff-6b6e-43ef-8897-f7a945881e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:41:51.511068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1361/2750] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:41:51.564798 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:41:51.577011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcbed1-b7dd-464e-adca-4cfd52fd8340 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:41:51.584137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081e892-22c8-46fd-819b-b11756f77802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:41:51.584745 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081e892-22c8-46fd-819b-b11756f77802 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:41:51.585014 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081e892-22c8-46fd-819b-b11756f77802 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:41:51.585278 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081e892-22c8-46fd-819b-b11756f77802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:41:51.593997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081e892-22c8-46fd-819b-b11756f77802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:41:51.595607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081e892-22c8-46fd-819b-b11756f77802 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:41:51.604229 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1390/2751] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:41:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:42:01.505213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:01.600609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:05.058286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe0e71-a64a-42b7-b9ec-13712754711c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.058799 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe0e71-a64a-42b7-b9ec-13712754711c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.058919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe0e71-a64a-42b7-b9ec-13712754711c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.060200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1362/2752] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:42:05.067061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4422a-8394-4c81-88c6-1fb967fa272e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.067559 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4422a-8394-4c81-88c6-1fb967fa272e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.067667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4422a-8394-4c81-88c6-1fb967fa272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.113701 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-69e4422a-8394-4c81-88c6-1fb967fa272e None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:42:05.115008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-69e4422a-8394-4c81-88c6-1fb967fa272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:42:05.197087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1391/2753] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:42:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:42:05.208632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe0e71-a64a-42b7-b9ec-13712754711c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:42:05.210684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eefe0e71-a64a-42b7-b9ec-13712754711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:42:05.278068 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe0e71-a64a-42b7-b9ec-13712754711c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:42:05.282490 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d293b4-e05c-4a55-891b-0e370f831851 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:42:05.283169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d293b4-e05c-4a55-891b-0e370f831851 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.283446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d293b4-e05c-4a55-891b-0e370f831851 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.283752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d293b4-e05c-4a55-891b-0e370f831851 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.295202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d293b4-e05c-4a55-891b-0e370f831851 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:42:05.296655 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d293b4-e05c-4a55-891b-0e370f831851 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:42:05.308633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1363/2754] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:42:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:42:05.385913 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf5cdd-4cc1-4d2d-812c-cdfbd0971ac2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.386183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf5cdd-4cc1-4d2d-812c-cdfbd0971ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.386454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf5cdd-4cc1-4d2d-812c-cdfbd0971ac2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.387809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1392/2755] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:42:05.392873 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c79b-308f-4a29-8799-60d0458cc179 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.393163 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c79b-308f-4a29-8799-60d0458cc179 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.393462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c79b-308f-4a29-8799-60d0458cc179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.428618 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e763c79b-308f-4a29-8799-60d0458cc179 None None] MFA Rules not processed for user `64c5c41465004c0a81fced6e8834a5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:42:05.429919 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e763c79b-308f-4a29-8799-60d0458cc179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:42:05.447899 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1364/2756] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:42:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:42:05.460965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf5cdd-4cc1-4d2d-812c-cdfbd0971ac2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:42:05.462904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-78bf5cdd-4cc1-4d2d-812c-cdfbd0971ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:42:05.477670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf5cdd-4cc1-4d2d-812c-cdfbd0971ac2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:42:05.481545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96f72a-ea0d-4041-84de-66e1692d874c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:42:05.482151 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f72a-ea0d-4041-84de-66e1692d874c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.482425 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f72a-ea0d-4041-84de-66e1692d874c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.482789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f72a-ea0d-4041-84de-66e1692d874c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.489759 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96f72a-ea0d-4041-84de-66e1692d874c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:42:05.491182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96f72a-ea0d-4041-84de-66e1692d874c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:42:05.498828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1393/2757] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:42:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:42:05.594282 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37644b31-424d-4962-8dbf-a273870cf896 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.594569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37644b31-424d-4962-8dbf-a273870cf896 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.594837 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37644b31-424d-4962-8dbf-a273870cf896 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.596876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1365/2758] 10.222.0.25 () {54 vars in 921 bytes} [Mon Aug 8 02:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:42:05.602454 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a10e3-7bd3-4eb4-9d15-810044d014a2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.602734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a10e3-7bd3-4eb4-9d15-810044d014a2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.603003 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a10e3-7bd3-4eb4-9d15-810044d014a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.624884 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-961a10e3-7bd3-4eb4-9d15-810044d014a2 None None] MFA Rules not processed for user `e0097046a5f7407d84884097fcfc4ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:42:05.626159 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-961a10e3-7bd3-4eb4-9d15-810044d014a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:42:05.637833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1394/2759] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Aug 8 02:42:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:42:05.649400 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37644b31-424d-4962-8dbf-a273870cf896 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:42:05.662152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37644b31-424d-4962-8dbf-a273870cf896 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:42:05.665955 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:42:05.666547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:05.666822 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:05.667090 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:05.677479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:42:05.678916 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:42:05.689988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1366/2760] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:42:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:42:07.351459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b85a3-e8b1-4fb1-a3fa-0dd50fe815b9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:07.351932 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b85a3-e8b1-4fb1-a3fa-0dd50fe815b9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:07.352025 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b85a3-e8b1-4fb1-a3fa-0dd50fe815b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:07.371027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6e8b85a3-e8b1-4fb1-a3fa-0dd50fe815b9 None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:42:07.372226 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e8b85a3-e8b1-4fb1-a3fa-0dd50fe815b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:42:07.379930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1395/2761] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Aug 8 02:42:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:42:07.392188 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:42:07.403935 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869ec0-3313-4a22-8b45-c92ac3cf650a service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:42:07.410297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:42:07.410909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:07.411179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:07.411449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:07.419606 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:42:07.421416 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:42:07.430397 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1367/2762] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:42:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:42:17.365881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=56 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:17.426923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=50 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:20.790648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:20.791147 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:20.791248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:20.810655 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] MFA Rules not processed for user `e91b89f02b6a4283bd61897eaefd47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:42:20.812177 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:42:20.820597 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1396/2763] 10.222.0.25 () {58 vars in 967 bytes} [Mon Aug 8 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:42:20.833131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:42:20.844023 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ceaae-aeec-47f3-91c5-2b68553736cd service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:42:20.851688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a07806d34b143f186cfc63ea192d6c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:42:20.852448 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:42:20.852802 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:42:20.852975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:42:20.861854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:42:20.863743 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:42:20.872809 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1368/2764] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Aug 8 02:42:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:42:30.805418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:30.868659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:04.014295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:04.016705 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:04.119490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6861be-aeb8-4b01-a45a-c9f2044313fb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:04.125408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:04.126286 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.126562 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.126862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] PATH_INFO: `/v3/users/d7aec24c192f469dbc76a8e525f10497` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.128389 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7aec24c192f469dbc76a8e525f10497)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:04.130338 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:04.183836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7aec24c192f469dbc76a8e525f10497'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.194179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7aec24c192f469dbc76a8e525f10497'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.207415 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7aec24c192f469dbc76a8e525f10497'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.208016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7aec24c192f469dbc76a8e525f10497'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.208637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4f2f078b-b4e8-4195-b600-b2b11024f889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7aec24c192f469dbc76a8e525f10497'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.220822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1397/2765] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:04 2022] DELETE /identity/v3/users/d7aec24c192f469dbc76a8e525f10497 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:04.404682 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:04.416688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a6805-4f1f-4c86-93f9-14afed505306 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:04.477942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:04.478499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.478778 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.479053 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] PATH_INFO: `/v3/projects/cff4ea2758e04e3380ffdaeb6b730d2a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.480299 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff4ea2758e04e3380ffdaeb6b730d2a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:04.482268 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:04.530218 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff4ea2758e04e3380ffdaeb6b730d2a', 'request_id': 'req-8507b771-993a-4cd6-8d53-8bae69f655b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.536669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff4ea2758e04e3380ffdaeb6b730d2a', 'request_id': 'req-8507b771-993a-4cd6-8d53-8bae69f655b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.546825 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff4ea2758e04e3380ffdaeb6b730d2a', 'request_id': 'req-8507b771-993a-4cd6-8d53-8bae69f655b0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.558776 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] The token cache is being invalidate because project cff4ea2758e04e3380ffdaeb6b730d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:04.559065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.559702 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8507b771-993a-4cd6-8d53-8bae69f655b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:04.561241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1369/2766] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:04 2022] DELETE /identity/v3/projects/cff4ea2758e04e3380ffdaeb6b730d2a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:43:04.566730 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6de37b-a50d-4672-9384-4631fe9fc7b7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.567020 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6de37b-a50d-4672-9384-4631fe9fc7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.567295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6de37b-a50d-4672-9384-4631fe9fc7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.613863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6c6de37b-a50d-4672-9384-4631fe9fc7b7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:04.615058 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6c6de37b-a50d-4672-9384-4631fe9fc7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:04.640837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:04.676372 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1398/2767] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:04.688676 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328737-9e04-4ff8-9db2-b4cbe3d86faf None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.688972 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328737-9e04-4ff8-9db2-b4cbe3d86faf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.689253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328737-9e04-4ff8-9db2-b4cbe3d86faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.711398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-01328737-9e04-4ff8-9db2-b4cbe3d86faf None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:04.713166 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-01328737-9e04-4ff8-9db2-b4cbe3d86faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:04.726910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1370/2768] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:04.731940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6de37b-a50d-4672-9384-4631fe9fc7b7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:04.744043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6de37b-a50d-4672-9384-4631fe9fc7b7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:04.750017 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:04.750653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.750930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.751198 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.751847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:43:04.752152 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:04.753784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:04.766141 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1399/2769] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:43:04.770744 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328737-9e04-4ff8-9db2-b4cbe3d86faf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:04.780915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328737-9e04-4ff8-9db2-b4cbe3d86faf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:04.787569 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:04.788169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.788446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.788713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.789337 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:04.791312 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:04.823590 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1371/2770] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:04 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:04.827862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:04.838185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096e1c6-7d15-4760-9e4c-94965277d778 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:04.898363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:04.899006 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.899288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.899558 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.900185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:04.902185 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:04.925997 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1400/2771] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:04 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:04.930821 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:04.946812 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb67b4-ca14-4dba-a448-fe027bf5d5dc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:04.954850 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:04.955710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.955967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.956463 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.957318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:04.958959 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:04.969477 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1372/2772] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:04.973670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:04.984105 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1f821-2100-46fc-8300-b4895c4486dd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:04.988772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13127353-3911-4aae-82e0-26ac2879f4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:04.989387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127353-3911-4aae-82e0-26ac2879f4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:04.989667 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127353-3911-4aae-82e0-26ac2879f4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:04.989933 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127353-3911-4aae-82e0-26ac2879f4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:04.990568 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13127353-3911-4aae-82e0-26ac2879f4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:04.992146 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13127353-3911-4aae-82e0-26ac2879f4ef admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.002865 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1401/2773] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:05.006925 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.016969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4da6d4-a9ab-47c3-808f-401292d56171 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.023451 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.024287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.024671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.025064 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] PATH_INFO: `/v3/projects/55db79d681064e9882343fb54de77451/users/9467d2f8941b4a7899f5c286607f4b1d/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.043491 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55db79d681064e9882343fb54de77451, user_id=9467d2f8941b4a7899f5c286607f4b1d, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.046215 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.061807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1373/2774] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:05 2022] PUT /identity/v3/projects/55db79d681064e9882343fb54de77451/users/9467d2f8941b4a7899f5c286607f4b1d/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:05.072870 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b92ef-581c-4c9c-9cd4-3931156516d6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.073418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b92ef-581c-4c9c-9cd4-3931156516d6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.073418 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b92ef-581c-4c9c-9cd4-3931156516d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.103169 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fa9b92ef-581c-4c9c-9cd4-3931156516d6 None None] MFA Rules not processed for user `9467d2f8941b4a7899f5c286607f4b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:05.104626 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fa9b92ef-581c-4c9c-9cd4-3931156516d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:05.171820 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1402/2775] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:05.176535 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.209257 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:05.243783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5ec0-72b0-477d-a7eb-fe83f25d0f1c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.249437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.250029 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.250304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.250568 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.251186 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.253185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.286619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1374/2776] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:05 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:05.290947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b92ef-581c-4c9c-9cd4-3931156516d6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.302585 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b92ef-581c-4c9c-9cd4-3931156516d6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.323255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:05.367203 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.367828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.368149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.368422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.369038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.371011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.393635 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1403/2777] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:05 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:05.397773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.408306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca3792-3bab-4585-8383-1b4f4b00b6ab admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.413840 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.414443 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.414715 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.414980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.415623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.417241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.428262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1375/2778] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:05.432930 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.444099 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ae66-473b-4d06-bc8f-6519e8d26b43 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.449920 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.450593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.450872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.451148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] PATH_INFO: `/v3/projects/98a0a454fa6f425293a3208bdbd1c4f0/users/effe3b325a054cad8dadb4af2630df62/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.467119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a0a454fa6f425293a3208bdbd1c4f0, user_id=effe3b325a054cad8dadb4af2630df62, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.469963 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.485514 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1404/2779] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:05 2022] PUT /identity/v3/projects/98a0a454fa6f425293a3208bdbd1c4f0/users/effe3b325a054cad8dadb4af2630df62/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:05.489975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.500949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e7170-8174-4abf-a999-b7e6acc4f782 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.560529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47af478-6d10-4d6b-8718-c21f0fb350e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.561135 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af478-6d10-4d6b-8718-c21f0fb350e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.561418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af478-6d10-4d6b-8718-c21f0fb350e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.561745 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af478-6d10-4d6b-8718-c21f0fb350e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.562747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47af478-6d10-4d6b-8718-c21f0fb350e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.564352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47af478-6d10-4d6b-8718-c21f0fb350e5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.574297 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1376/2780] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:05.578736 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.589847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2630e-e1e1-4c23-b5a6-33ae4a0695f6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.595135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.595789 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.596070 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.596347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] PATH_INFO: `/v3/projects/98a0a454fa6f425293a3208bdbd1c4f0/users/effe3b325a054cad8dadb4af2630df62/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.598593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a0a454fa6f425293a3208bdbd1c4f0, user_id=effe3b325a054cad8dadb4af2630df62, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.601236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.613179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1405/2781] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:05 2022] PUT /identity/v3/projects/98a0a454fa6f425293a3208bdbd1c4f0/users/effe3b325a054cad8dadb4af2630df62/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:05.623875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f9f7-2ed3-40b1-b52d-c2279de9c6b6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.624190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f9f7-2ed3-40b1-b52d-c2279de9c6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.624582 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f9f7-2ed3-40b1-b52d-c2279de9c6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.660622 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0b71f9f7-2ed3-40b1-b52d-c2279de9c6b6 None None] MFA Rules not processed for user `effe3b325a054cad8dadb4af2630df62`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:05.662243 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0b71f9f7-2ed3-40b1-b52d-c2279de9c6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:05.736392 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1377/2782] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:05.751843 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.753855 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:05.844485 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5840-3989-49de-b5d3-e08a66873629 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:05.848654 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c199a9-7a7a-4eaa-9425-84490030e62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:05.849261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c199a9-7a7a-4eaa-9425-84490030e62e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:05.849573 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c199a9-7a7a-4eaa-9425-84490030e62e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:05.849851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c199a9-7a7a-4eaa-9425-84490030e62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:05.858949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c199a9-7a7a-4eaa-9425-84490030e62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:05.860382 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c199a9-7a7a-4eaa-9425-84490030e62e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:05.869799 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1406/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:05.942303 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f9f7-2ed3-40b1-b52d-c2279de9c6b6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:05.969150 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:06.010484 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f9f7-2ed3-40b1-b52d-c2279de9c6b6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:06.015779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:06.016411 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:06.016686 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:06.017102 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] PATH_INFO: `/v3/users/9467d2f8941b4a7899f5c286607f4b1d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:06.018309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9467d2f8941b4a7899f5c286607f4b1d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:06.020354 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:06.074374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9467d2f8941b4a7899f5c286607f4b1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.083906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9467d2f8941b4a7899f5c286607f4b1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.084998 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9467d2f8941b4a7899f5c286607f4b1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.101551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9467d2f8941b4a7899f5c286607f4b1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.102198 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9467d2f8941b4a7899f5c286607f4b1d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.114429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1378/2784] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:05 2022] DELETE /identity/v3/users/9467d2f8941b4a7899f5c286607f4b1d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:06.119260 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:06.119733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:06.119830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:06.139459 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:06.140679 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:06.196204 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:06.206110 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1407/2785] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:06.215894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:06.217612 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:06.277128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0b8ba-ea1f-4a97-8044-6f9065ea34e8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:06.281207 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:06.281826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:06.282101 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:06.282373 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:06.291883 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:06.293336 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:06.302909 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1379/2786] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:06.609692 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:06.611431 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:06.627336 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc304fe-06d4-4151-9634-d033cdf4b4bd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:06.632912 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:06.633618 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:06.633900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:06.634171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] PATH_INFO: `/v3/projects/55db79d681064e9882343fb54de77451` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:06.635487 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55db79d681064e9882343fb54de77451)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:06.637420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:06.685968 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55db79d681064e9882343fb54de77451', 'request_id': 'req-c7a6097a-4afc-46ca-976e-e9ad027d3376'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.692580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55db79d681064e9882343fb54de77451', 'request_id': 'req-c7a6097a-4afc-46ca-976e-e9ad027d3376'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.703132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55db79d681064e9882343fb54de77451', 'request_id': 'req-c7a6097a-4afc-46ca-976e-e9ad027d3376'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.713542 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] The token cache is being invalidate because project 55db79d681064e9882343fb54de77451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:06.713833 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.714449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.715939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1408/2787] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:06 2022] DELETE /identity/v3/projects/55db79d681064e9882343fb54de77451 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:06.720742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:06.731179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a9c91-1c6d-41ba-89d7-9a2932d89eb2 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:06.772572 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:06.788969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:06.789637 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:06.789921 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:06.790194 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] PATH_INFO: `/v3/users/effe3b325a054cad8dadb4af2630df62` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:06.791319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=effe3b325a054cad8dadb4af2630df62)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:06.793265 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:06.850031 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effe3b325a054cad8dadb4af2630df62'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.859151 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effe3b325a054cad8dadb4af2630df62'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.860006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effe3b325a054cad8dadb4af2630df62'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.872342 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effe3b325a054cad8dadb4af2630df62'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.873145 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6565c93d-0324-4b13-afb8-0bce1d23b2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effe3b325a054cad8dadb4af2630df62'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:06.886855 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1380/2788] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:06 2022] DELETE /identity/v3/users/effe3b325a054cad8dadb4af2630df62 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:07.169170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.170863 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:07.186935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6097a-4afc-46ca-976e-e9ad027d3376 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.245616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.246255 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.246531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.246814 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] PATH_INFO: `/v3/projects/98a0a454fa6f425293a3208bdbd1c4f0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.247965 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a0a454fa6f425293a3208bdbd1c4f0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.249936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:07.296616 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a0a454fa6f425293a3208bdbd1c4f0', 'request_id': 'req-3c16f93d-2c07-4d52-a7df-b443ceac25ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:07.303137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a0a454fa6f425293a3208bdbd1c4f0', 'request_id': 'req-3c16f93d-2c07-4d52-a7df-b443ceac25ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:07.312945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a0a454fa6f425293a3208bdbd1c4f0', 'request_id': 'req-3c16f93d-2c07-4d52-a7df-b443ceac25ee'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:07.323532 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] The token cache is being invalidate because project 98a0a454fa6f425293a3208bdbd1c4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:07.323822 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:07.324436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c16f93d-2c07-4d52-a7df-b443ceac25ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:07.325967 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1409/2789] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:07 2022] DELETE /identity/v3/projects/98a0a454fa6f425293a3208bdbd1c4f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:07.331143 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c5b0-e54a-4d1c-8dd6-8734f5fbfbb0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.331506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c5b0-e54a-4d1c-8dd6-8734f5fbfbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.331834 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c5b0-e54a-4d1c-8dd6-8734f5fbfbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.353865 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c421c5b0-e54a-4d1c-8dd6-8734f5fbfbb0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:07.355093 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c421c5b0-e54a-4d1c-8dd6-8734f5fbfbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:07.422747 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1381/2790] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:07.432419 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab44bd-4d9e-4810-a3d4-30dedbd89d87 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.432698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab44bd-4d9e-4810-a3d4-30dedbd89d87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.432941 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab44bd-4d9e-4810-a3d4-30dedbd89d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.453984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5eab44bd-4d9e-4810-a3d4-30dedbd89d87 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:07.455195 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5eab44bd-4d9e-4810-a3d4-30dedbd89d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:07.463983 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1410/2791] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:07.468478 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c5b0-e54a-4d1c-8dd6-8734f5fbfbb0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.479119 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c5b0-e54a-4d1c-8dd6-8734f5fbfbb0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.484600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.485209 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.485523 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.485797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.486549 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:43:07.486863 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.488621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:07.500360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1382/2792] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:43:07.504784 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab44bd-4d9e-4810-a3d4-30dedbd89d87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.514364 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab44bd-4d9e-4810-a3d4-30dedbd89d87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.519470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.520096 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.520343 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.520627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.521248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.523179 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:07.527771 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:07.553982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1411/2793] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:07 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:43:07.558323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.568851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e412ad-0bb1-46ad-a588-33eb8db6f94f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.618779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:07.629712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.630476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.630803 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.631431 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.632115 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.634190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:07.658106 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1383/2794] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:07 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:07.662700 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.673301 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03e1b-8d08-45fe-a814-aefe3b01fd74 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.678903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.679509 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.679783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.680050 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.680746 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.682365 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:07.693741 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1412/2795] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:07.698007 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.708601 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad467e5-ecb4-400d-bb4b-5e33bf971371 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.713908 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e733d-932d-4784-bfe7-553662346b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.714527 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e733d-932d-4784-bfe7-553662346b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.714774 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e733d-932d-4784-bfe7-553662346b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.715076 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e733d-932d-4784-bfe7-553662346b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.715752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e733d-932d-4784-bfe7-553662346b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.717440 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e733d-932d-4784-bfe7-553662346b38 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:07.728468 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1384/2796] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:07.732938 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.743827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9385-8d15-4dee-8725-480a62b622df admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.748761 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.749412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.749722 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.749991 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] PATH_INFO: `/v3/projects/2b06b70ee0254bc3aa5df7fa5e254742/users/364a3d2fa7374953b067b30bdb77a258/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.765182 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b06b70ee0254bc3aa5df7fa5e254742, user_id=364a3d2fa7374953b067b30bdb77a258, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.767922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:07.782605 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1413/2797] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:07 2022] PUT /identity/v3/projects/2b06b70ee0254bc3aa5df7fa5e254742/users/364a3d2fa7374953b067b30bdb77a258/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:07.793157 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e6d9-2716-481d-9f49-7d9637208a3c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.793547 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e6d9-2716-481d-9f49-7d9637208a3c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.793826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e6d9-2716-481d-9f49-7d9637208a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.827142 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3226e6d9-2716-481d-9f49-7d9637208a3c None None] MFA Rules not processed for user `364a3d2fa7374953b067b30bdb77a258`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:07.828353 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3226e6d9-2716-481d-9f49-7d9637208a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:07.893656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1385/2798] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:07.899217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:07.964120 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e9d0-fba5-4b65-9d2d-d19feb6e46d0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:07.969154 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:07.969788 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:07.970066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:07.970332 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:07.970957 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:07.973021 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:08.003689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1414/2799] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:07 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:08.008349 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e6d9-2716-481d-9f49-7d9637208a3c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:08.019283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e6d9-2716-481d-9f49-7d9637208a3c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:08.082654 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:08.083270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:08.083546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:08.083793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:08.084418 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:08.086395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:08.111138 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1386/2800] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:08 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:08.115323 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:08.125685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef950a4-d26c-4239-ab8f-1802374e55d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:08.131038 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:08.131672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:08.132378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:08.132378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:08.132880 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:08.134681 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:08.148270 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1415/2801] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:08.152718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:08.163315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428021-9a19-4ab6-9afe-9c530da52634 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:08.168235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:08.168891 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:08.169174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:08.169482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] PATH_INFO: `/v3/projects/ffce5cb1548d483ba592c61c052f4ff7/users/c99742814f2f4cb99404ff4a91da80e3/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:08.184425 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffce5cb1548d483ba592c61c052f4ff7, user_id=c99742814f2f4cb99404ff4a91da80e3, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:08.187525 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:08.202797 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1387/2802] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:08 2022] PUT /identity/v3/projects/ffce5cb1548d483ba592c61c052f4ff7/users/c99742814f2f4cb99404ff4a91da80e3/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:08.207531 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:08.218254 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7089478-a196-40b1-855c-6f565b95c9bc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:08.281940 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f453be8-0ba8-402b-9717-360b84e8be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:08.282750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453be8-0ba8-402b-9717-360b84e8be06 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:08.283111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453be8-0ba8-402b-9717-360b84e8be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:08.283488 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453be8-0ba8-402b-9717-360b84e8be06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:08.284475 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f453be8-0ba8-402b-9717-360b84e8be06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:08.286544 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f453be8-0ba8-402b-9717-360b84e8be06 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:08.297277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1416/2803] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:43:08.303502 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:08.315330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520235-e826-47cf-8006-814ba58d79be admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:08.321005 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:08.321684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:08.321960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:08.322259 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] PATH_INFO: `/v3/projects/ffce5cb1548d483ba592c61c052f4ff7/users/c99742814f2f4cb99404ff4a91da80e3/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:08.324332 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffce5cb1548d483ba592c61c052f4ff7, user_id=c99742814f2f4cb99404ff4a91da80e3, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:08.327011 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:08.339322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1388/2804] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:08 2022] PUT /identity/v3/projects/ffce5cb1548d483ba592c61c052f4ff7/users/c99742814f2f4cb99404ff4a91da80e3/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:08.351132 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eedfd7-758d-4ca3-9c19-534d4439281f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:08.351517 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eedfd7-758d-4ca3-9c19-534d4439281f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:08.351931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eedfd7-758d-4ca3-9c19-534d4439281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:08.389867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-62eedfd7-758d-4ca3-9c19-534d4439281f None None] MFA Rules not processed for user `c99742814f2f4cb99404ff4a91da80e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:08.391079 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-62eedfd7-758d-4ca3-9c19-534d4439281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:08.400049 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:08.460410 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1417/2805] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:08.471902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:08.474126 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:08.489063 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:08.541251 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5043f5-e4ca-4431-8294-bd2e43dff081 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:08.545242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2c0f1-df24-45f4-8396-a8df0010f205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:08.545882 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2c0f1-df24-45f4-8396-a8df0010f205 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:08.546152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2c0f1-df24-45f4-8396-a8df0010f205 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:08.546422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2c0f1-df24-45f4-8396-a8df0010f205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:08.555552 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2c0f1-df24-45f4-8396-a8df0010f205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:08.556988 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2c0f1-df24-45f4-8396-a8df0010f205 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:08.566993 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1389/2806] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:09.194053 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eedfd7-758d-4ca3-9c19-534d4439281f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:09.258886 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eedfd7-758d-4ca3-9c19-534d4439281f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:09.263670 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:09.264381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:09.264744 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:09.265042 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] PATH_INFO: `/v3/users/364a3d2fa7374953b067b30bdb77a258` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:09.266211 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] RBAC: Authorizing `identity:delete_user(user_id=364a3d2fa7374953b067b30bdb77a258)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:09.268201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:09.318851 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364a3d2fa7374953b067b30bdb77a258'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.327819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364a3d2fa7374953b067b30bdb77a258'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.340371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364a3d2fa7374953b067b30bdb77a258'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.341097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364a3d2fa7374953b067b30bdb77a258'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.341734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364a3d2fa7374953b067b30bdb77a258'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.354587 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1418/2807] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:09 2022] DELETE /identity/v3/users/364a3d2fa7374953b067b30bdb77a258 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:09.359466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:09.359974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:09.359974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:09.380393 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:09.381659 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:09.446293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1390/2808] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:09.456563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:09.459028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:09.496005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:09.528103 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07f651-f7f8-4b4a-9126-e9c0bb9f476a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:09.532245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:09.532862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:09.533144 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:09.533445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:09.543565 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:09.545007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:09.554832 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1419/2809] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:09.835421 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:09.837200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:09.851315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1231f7-c8bc-4730-b5ac-e302af7c5b27 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:09.856263 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:09.856906 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:09.857180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:09.857492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] PATH_INFO: `/v3/projects/2b06b70ee0254bc3aa5df7fa5e254742` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:09.859214 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b06b70ee0254bc3aa5df7fa5e254742)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:09.861360 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:09.914235 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b06b70ee0254bc3aa5df7fa5e254742', 'request_id': 'req-a3514da3-1576-417b-8550-9d34bba82e0d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.922483 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b06b70ee0254bc3aa5df7fa5e254742', 'request_id': 'req-a3514da3-1576-417b-8550-9d34bba82e0d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.933683 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b06b70ee0254bc3aa5df7fa5e254742', 'request_id': 'req-a3514da3-1576-417b-8550-9d34bba82e0d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.944872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] The token cache is being invalidate because project 2b06b70ee0254bc3aa5df7fa5e254742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:09.945192 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.945893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:09.947432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1391/2810] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:09 2022] DELETE /identity/v3/projects/2b06b70ee0254bc3aa5df7fa5e254742 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:09.951758 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:09.961669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72cb74-7b09-46ce-b76a-98b836e1eb73 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.019619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.020326 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.020617 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.020888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] PATH_INFO: `/v3/users/c99742814f2f4cb99404ff4a91da80e3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.022072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99742814f2f4cb99404ff4a91da80e3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:10.024036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:10.075279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99742814f2f4cb99404ff4a91da80e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.084281 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99742814f2f4cb99404ff4a91da80e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.095797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99742814f2f4cb99404ff4a91da80e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.096409 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99742814f2f4cb99404ff4a91da80e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.097028 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-153ecefb-6635-4c6b-b6ef-585547e6d446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99742814f2f4cb99404ff4a91da80e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.109371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1420/2811] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:09 2022] DELETE /identity/v3/users/c99742814f2f4cb99404ff4a91da80e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:10.402270 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:10.403784 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:10.418757 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514da3-1576-417b-8550-9d34bba82e0d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.455658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:10.480444 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.481075 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.481352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.481652 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] PATH_INFO: `/v3/projects/ffce5cb1548d483ba592c61c052f4ff7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.482783 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffce5cb1548d483ba592c61c052f4ff7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:10.484719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:10.541256 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffce5cb1548d483ba592c61c052f4ff7', 'request_id': 'req-afffa38c-00fc-4a64-a716-c42e2349a6ca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.547560 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffce5cb1548d483ba592c61c052f4ff7', 'request_id': 'req-afffa38c-00fc-4a64-a716-c42e2349a6ca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.557697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffce5cb1548d483ba592c61c052f4ff7', 'request_id': 'req-afffa38c-00fc-4a64-a716-c42e2349a6ca'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.568488 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] The token cache is being invalidate because project ffce5cb1548d483ba592c61c052f4ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:10.568771 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.569438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-afffa38c-00fc-4a64-a716-c42e2349a6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:10.570979 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1392/2812] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:10 2022] DELETE /identity/v3/projects/ffce5cb1548d483ba592c61c052f4ff7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:10.575915 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc436246-e5a2-4a89-94e1-a8b799ca6dbe None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.576412 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc436246-e5a2-4a89-94e1-a8b799ca6dbe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.576521 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc436246-e5a2-4a89-94e1-a8b799ca6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.597577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fc436246-e5a2-4a89-94e1-a8b799ca6dbe None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:10.598937 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fc436246-e5a2-4a89-94e1-a8b799ca6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:10.641710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:10.661072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1421/2813] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:10.669300 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91116e-82dc-4b69-9ff5-b56c4402a7bb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.669629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91116e-82dc-4b69-9ff5-b56c4402a7bb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.669954 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91116e-82dc-4b69-9ff5-b56c4402a7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.692017 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ed91116e-82dc-4b69-9ff5-b56c4402a7bb None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:10.693077 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed91116e-82dc-4b69-9ff5-b56c4402a7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:10.702374 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1393/2814] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:10.706702 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc436246-e5a2-4a89-94e1-a8b799ca6dbe None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:10.717443 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc436246-e5a2-4a89-94e1-a8b799ca6dbe None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.722961 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.723739 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.724016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.724284 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.724924 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:43:10.725225 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:10.726854 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:10.739005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1422/2815] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:43:10.743556 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91116e-82dc-4b69-9ff5-b56c4402a7bb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:10.753278 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91116e-82dc-4b69-9ff5-b56c4402a7bb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.759245 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.759910 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.760213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.760506 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.761177 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:10.763148 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:10.793254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1394/2816] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:10 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:10.797607 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:10.808236 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618c216-b3a8-4850-a31c-6d56cb5f1967 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.876637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.877149 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.877455 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.877727 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.878383 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:10.880348 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:10.905085 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1423/2817] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:10 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:43:10.909406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:10.920289 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54cff7-8777-4946-85ba-9293e2b0930f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.925975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.926652 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.926940 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.927204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.927859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:10.929528 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:10.940567 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1395/2818] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:10.945235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:10.956043 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a666a8-ffab-4675-b42a-d550a8c5000c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.961135 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9349-ec3f-4246-b5cb-6998ce6cac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.961847 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9349-ec3f-4246-b5cb-6998ce6cac08 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.962119 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9349-ec3f-4246-b5cb-6998ce6cac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.962392 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9349-ec3f-4246-b5cb-6998ce6cac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:10.963026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9349-ec3f-4246-b5cb-6998ce6cac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:10.964699 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9349-ec3f-4246-b5cb-6998ce6cac08 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:10.977163 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1424/2819] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:10.982006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:10.992904 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b88edf-3462-4950-9b71-ea191caead2d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:10.998280 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:10.998975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:10.999261 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:10.999537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] PATH_INFO: `/v3/projects/7fc05b919ecd49beab94b4caeebb8fac/users/79d851d8bdd04470baadf160acb8b013/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.016168 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc05b919ecd49beab94b4caeebb8fac, user_id=79d851d8bdd04470baadf160acb8b013, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.018915 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.035790 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1396/2820] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:10 2022] PUT /identity/v3/projects/7fc05b919ecd49beab94b4caeebb8fac/users/79d851d8bdd04470baadf160acb8b013/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:11.046628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f01f8-895c-4ec7-8c27-db8356cd73b3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.046947 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f01f8-895c-4ec7-8c27-db8356cd73b3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.047215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f01f8-895c-4ec7-8c27-db8356cd73b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.078190 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9d3f01f8-895c-4ec7-8c27-db8356cd73b3 None None] MFA Rules not processed for user `79d851d8bdd04470baadf160acb8b013`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:11.079422 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9d3f01f8-895c-4ec7-8c27-db8356cd73b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:11.146076 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1425/2821] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:11.150828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:11.217013 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdb69a-4498-4da6-a54b-6bbd608758e1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:11.222375 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:11.222982 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.223246 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.223579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.224200 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.226179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.235813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:11.258220 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1397/2822] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:11 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:11.262393 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f01f8-895c-4ec7-8c27-db8356cd73b3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:11.273610 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f01f8-895c-4ec7-8c27-db8356cd73b3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:11.315717 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:11.338916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:11.339541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.339823 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.340097 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.340765 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.342770 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.366200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1426/2823] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:11 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:11.370438 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:11.381276 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3294c8-973e-4404-93a6-6f08d52fbd8a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:11.386719 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:11.387322 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.387600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.387858 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.388505 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.390181 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.401348 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1398/2824] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:43:11.405637 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:11.416337 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368fe6-2adf-4c64-b236-23ef59e4a75b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:11.421333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:11.421982 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.422307 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.422579 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] PATH_INFO: `/v3/projects/230791871e7a486f9be3795e3d625c57/users/47e274d4f64a43f68408c0938b3b6b93/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.442550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230791871e7a486f9be3795e3d625c57, user_id=47e274d4f64a43f68408c0938b3b6b93, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.446536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.468046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1427/2825] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:11 2022] PUT /identity/v3/projects/230791871e7a486f9be3795e3d625c57/users/47e274d4f64a43f68408c0938b3b6b93/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:11.472656 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:11.483897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb20d-d2c0-411b-bc7e-3da189885b97 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:11.542315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6cbba-6439-44d9-a08d-c871024ba047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:11.543015 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6cbba-6439-44d9-a08d-c871024ba047 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.543287 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6cbba-6439-44d9-a08d-c871024ba047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.543559 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6cbba-6439-44d9-a08d-c871024ba047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.544197 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6cbba-6439-44d9-a08d-c871024ba047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.545826 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6cbba-6439-44d9-a08d-c871024ba047 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.555773 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1399/2826] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:11.560436 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:11.571979 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c336-4cd7-4cd0-a36a-3ffdde0fb854 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:11.577793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:11.578445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.578734 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.579004 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] PATH_INFO: `/v3/projects/230791871e7a486f9be3795e3d625c57/users/47e274d4f64a43f68408c0938b3b6b93/roles/1470302d39e340299072b424021b764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.581023 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230791871e7a486f9be3795e3d625c57, user_id=47e274d4f64a43f68408c0938b3b6b93, role_id=1470302d39e340299072b424021b764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.583796 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.594107 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1428/2827] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:11 2022] PUT /identity/v3/projects/230791871e7a486f9be3795e3d625c57/users/47e274d4f64a43f68408c0938b3b6b93/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:11.660851 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af4d52-4e4b-4be9-a5f0-d8bd2b26519e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.661060 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af4d52-4e4b-4be9-a5f0-d8bd2b26519e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.661684 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af4d52-4e4b-4be9-a5f0-d8bd2b26519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.690893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-40af4d52-4e4b-4be9-a5f0-d8bd2b26519e None None] MFA Rules not processed for user `47e274d4f64a43f68408c0938b3b6b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:11.692100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-40af4d52-4e4b-4be9-a5f0-d8bd2b26519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:11.762939 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1400/2828] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:11.774319 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:11.776438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:11.839293 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251caa8e-23bf-4a30-b8b3-eeb3406f0a41 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:11.843962 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7990be-a1c0-44ce-a2ee-25650cc81fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:11.844603 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7990be-a1c0-44ce-a2ee-25650cc81fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:11.844858 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7990be-a1c0-44ce-a2ee-25650cc81fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:11.845133 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7990be-a1c0-44ce-a2ee-25650cc81fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:11.855921 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7990be-a1c0-44ce-a2ee-25650cc81fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:11.857384 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7990be-a1c0-44ce-a2ee-25650cc81fe9 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:11.867569 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1429/2829] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:12.262247 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af4d52-4e4b-4be9-a5f0-d8bd2b26519e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:12.331422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af4d52-4e4b-4be9-a5f0-d8bd2b26519e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:12.336807 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:12.337476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:12.337762 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:12.338039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] PATH_INFO: `/v3/users/79d851d8bdd04470baadf160acb8b013` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:12.339190 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d851d8bdd04470baadf160acb8b013)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:12.341131 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:12.342787 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:12.398748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d851d8bdd04470baadf160acb8b013'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:12.407532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d851d8bdd04470baadf160acb8b013'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:12.408249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d851d8bdd04470baadf160acb8b013'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:12.422831 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d851d8bdd04470baadf160acb8b013'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:12.423476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d851d8bdd04470baadf160acb8b013'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:12.436860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1401/2830] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:12 2022] DELETE /identity/v3/users/79d851d8bdd04470baadf160acb8b013 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:12.441780 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:12.442066 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:12.442333 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:12.462640 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:12.463894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:12.526158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1430/2831] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:12.533211 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:12.534703 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:12.592476 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077662-7958-4ef3-84a7-a32a93f19928 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:12.596272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:12.596885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:12.597184 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:12.597504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:12.607201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:12.608661 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:12.619508 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1402/2832] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:12.908733 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:12.910381 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:12.923339 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b222f-bb12-4410-8dbc-df0e6dfb67a0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:12.928653 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:12.929445 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:12.929602 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:12.929878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] PATH_INFO: `/v3/projects/7fc05b919ecd49beab94b4caeebb8fac` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:12.931074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc05b919ecd49beab94b4caeebb8fac)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:12.935672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:12.976978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:12.991785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc05b919ecd49beab94b4caeebb8fac', 'request_id': 'req-f6b5460d-07b6-45d2-a478-cbf69101267c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:12.998054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc05b919ecd49beab94b4caeebb8fac', 'request_id': 'req-f6b5460d-07b6-45d2-a478-cbf69101267c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.008243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc05b919ecd49beab94b4caeebb8fac', 'request_id': 'req-f6b5460d-07b6-45d2-a478-cbf69101267c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.019611 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] The token cache is being invalidate because project 7fc05b919ecd49beab94b4caeebb8fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:13.019899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.020515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.022156 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1431/2833] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:12 2022] DELETE /identity/v3/projects/7fc05b919ecd49beab94b4caeebb8fac => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:13.026446 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:13.036152 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e8eb-a3ff-47f5-b7ce-8a41ae993a38 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:13.103088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:13.104027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.104395 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.104742 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] PATH_INFO: `/v3/users/47e274d4f64a43f68408c0938b3b6b93` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.106406 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e274d4f64a43f68408c0938b3b6b93)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:13.109273 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:13.134793 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:13.162596 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e274d4f64a43f68408c0938b3b6b93'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.171344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e274d4f64a43f68408c0938b3b6b93'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.171969 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e274d4f64a43f68408c0938b3b6b93'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.184697 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e274d4f64a43f68408c0938b3b6b93'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.185434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cc0516de-03ad-45b6-aaa4-e714bd3af8ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e274d4f64a43f68408c0938b3b6b93'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.198352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1403/2834] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:13 2022] DELETE /identity/v3/users/47e274d4f64a43f68408c0938b3b6b93 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:13.489328 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:13.491515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:13.506491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5460d-07b6-45d2-a478-cbf69101267c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:13.564064 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:13.564598 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.564875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.565142 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] PATH_INFO: `/v3/projects/230791871e7a486f9be3795e3d625c57` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.566335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=230791871e7a486f9be3795e3d625c57)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:13.568251 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:13.618694 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230791871e7a486f9be3795e3d625c57', 'request_id': 'req-64d56ea1-539e-4213-99d4-5d58fbee24d3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.625263 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230791871e7a486f9be3795e3d625c57', 'request_id': 'req-64d56ea1-539e-4213-99d4-5d58fbee24d3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.635838 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230791871e7a486f9be3795e3d625c57', 'request_id': 'req-64d56ea1-539e-4213-99d4-5d58fbee24d3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.646123 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] The token cache is being invalidate because project 230791871e7a486f9be3795e3d625c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:13.646407 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.647126 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-64d56ea1-539e-4213-99d4-5d58fbee24d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:13.648633 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1432/2835] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:13 2022] DELETE /identity/v3/projects/230791871e7a486f9be3795e3d625c57 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:13.653551 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9e603-b29f-435b-ac5c-ea500c530c94 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.654014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9e603-b29f-435b-ac5c-ea500c530c94 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.654111 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9e603-b29f-435b-ac5c-ea500c530c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.674361 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-eea9e603-b29f-435b-ac5c-ea500c530c94 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:13.675555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eea9e603-b29f-435b-ac5c-ea500c530c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:13.741859 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1404/2836] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:13.749827 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152288-e9aa-422d-8244-9bd2b66c88d7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.750106 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152288-e9aa-422d-8244-9bd2b66c88d7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.750373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152288-e9aa-422d-8244-9bd2b66c88d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.771007 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-28152288-e9aa-422d-8244-9bd2b66c88d7 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:13.772306 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-28152288-e9aa-422d-8244-9bd2b66c88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:13.781335 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1433/2837] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:13.785643 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9e603-b29f-435b-ac5c-ea500c530c94 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:13.795479 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9e603-b29f-435b-ac5c-ea500c530c94 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:13.800441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:13.801044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.801315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.801623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.802272 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:43:13.802574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:13.804399 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:13.816875 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1405/2838] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:43:13.821420 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152288-e9aa-422d-8244-9bd2b66c88d7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:13.831408 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152288-e9aa-422d-8244-9bd2b66c88d7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:13.836931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:13.837567 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.837844 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.838113 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.838764 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:13.840656 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:13.871491 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1434/2839] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:13 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:13.875852 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:13.886352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb750-ca46-41e0-af06-e6e96393d33e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:13.944629 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:13.945213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.945543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.945819 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.946437 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:13.948372 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:13.970980 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1406/2840] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:13 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:13.975497 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:13.987317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3604110-fd3e-45d4-848c-7eb0d4a983d8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:13.993668 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:13.994622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:13.994904 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:13.995180 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:13.995916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:13.997594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.008923 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1435/2841] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:14.013167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.024426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce21a-37bf-42f1-b2df-0c91be02f0ab admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.029889 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77330-9cf6-448a-afd3-8ee5b60f0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.030485 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77330-9cf6-448a-afd3-8ee5b60f0033 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.030791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77330-9cf6-448a-afd3-8ee5b60f0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.031044 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77330-9cf6-448a-afd3-8ee5b60f0033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.031726 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77330-9cf6-448a-afd3-8ee5b60f0033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.033347 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77330-9cf6-448a-afd3-8ee5b60f0033 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.044293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1407/2842] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:14.048669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.059620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb5d8-1f7e-4c34-88f3-75d37d4014a6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.065162 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.065852 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.066131 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.066404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] PATH_INFO: `/v3/projects/9efaeb33189a42b9b358da0b5a9c2297/users/68e5e1c58e6a44a780416a040ca0f10a/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.075232 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:14.083664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efaeb33189a42b9b358da0b5a9c2297, user_id=68e5e1c58e6a44a780416a040ca0f10a, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.087121 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.103083 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1436/2843] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:14 2022] PUT /identity/v3/projects/9efaeb33189a42b9b358da0b5a9c2297/users/68e5e1c58e6a44a780416a040ca0f10a/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:14.113185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f2f1-e2b7-4d3e-9b75-46d3fa8882f8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.113536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f2f1-e2b7-4d3e-9b75-46d3fa8882f8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.113813 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f2f1-e2b7-4d3e-9b75-46d3fa8882f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.132750 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:14.150081 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-72d2f2f1-e2b7-4d3e-9b75-46d3fa8882f8 None None] MFA Rules not processed for user `68e5e1c58e6a44a780416a040ca0f10a`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:14.151946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-72d2f2f1-e2b7-4d3e-9b75-46d3fa8882f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:14.223296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1408/2844] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:14.229087 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.301623 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba264d-a3c4-48fd-a769-f93523029e1e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.306936 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.307539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.307817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.308077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.308713 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.310672 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.339890 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1437/2845] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:14 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:14.343718 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2f2f1-e2b7-4d3e-9b75-46d3fa8882f8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.356434 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2f2f1-e2b7-4d3e-9b75-46d3fa8882f8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.418045 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.418658 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.418999 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.419274 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.419898 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.421877 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.449713 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1409/2846] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:14 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:14.453952 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.465329 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38c162-ccf1-426b-8595-0437947a3c4f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.470294 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.470892 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.471170 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.471444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.472079 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.473712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.484642 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1438/2847] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:14.488951 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.500139 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb4902-95f6-4d00-8b5d-e1edd92c159b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.506174 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.506967 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.507286 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.507681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] PATH_INFO: `/v3/projects/e733f0bc344a4b1b9965ea42bab3ec9a/users/3fe3ecc3e08f4ba38252424500e072c5/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.528216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e733f0bc344a4b1b9965ea42bab3ec9a, user_id=3fe3ecc3e08f4ba38252424500e072c5, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.530918 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.546669 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1410/2848] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:14 2022] PUT /identity/v3/projects/e733f0bc344a4b1b9965ea42bab3ec9a/users/3fe3ecc3e08f4ba38252424500e072c5/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:14.550806 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.561621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b791-6f33-4998-896e-0a120e84bf29 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.623545 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87396179-25b3-49ea-95b4-184ec08cf384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.624077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87396179-25b3-49ea-95b4-184ec08cf384 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.624355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87396179-25b3-49ea-95b4-184ec08cf384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.624620 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87396179-25b3-49ea-95b4-184ec08cf384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.625246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87396179-25b3-49ea-95b4-184ec08cf384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.626922 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87396179-25b3-49ea-95b4-184ec08cf384 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.637807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1439/2849] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:14.642213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.654398 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dcba-6110-4001-b623-312a9e5fa3d6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.659319 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.659961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.660234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.660504 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] PATH_INFO: `/v3/projects/e733f0bc344a4b1b9965ea42bab3ec9a/users/3fe3ecc3e08f4ba38252424500e072c5/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.662472 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e733f0bc344a4b1b9965ea42bab3ec9a, user_id=3fe3ecc3e08f4ba38252424500e072c5, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.665355 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.675449 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1411/2850] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:14 2022] PUT /identity/v3/projects/e733f0bc344a4b1b9965ea42bab3ec9a/users/3fe3ecc3e08f4ba38252424500e072c5/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:14.687111 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe077-d52c-4f73-8d44-4151bcae3793 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.687776 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe077-d52c-4f73-8d44-4151bcae3793 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.688046 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe077-d52c-4f73-8d44-4151bcae3793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.716594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c09fe077-d52c-4f73-8d44-4151bcae3793 None None] MFA Rules not processed for user `3fe3ecc3e08f4ba38252424500e072c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:14.717856 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c09fe077-d52c-4f73-8d44-4151bcae3793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:14.775929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:14.804387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1440/2851] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:14.817167 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:14.819352 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:14.878729 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:14.883708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e14d8-02e8-40fb-899b-b511c4c74b66 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:14.888185 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:14.888938 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:14.889215 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:14.889521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:14.899055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:14.900500 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:14.909781 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1412/2852] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:15.018350 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fe077-d52c-4f73-8d44-4151bcae3793 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:15.034346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fe077-d52c-4f73-8d44-4151bcae3793 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:15.039387 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea132284-0e33-4aad-95ba-0bccd6d1ca7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:15.040140 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea132284-0e33-4aad-95ba-0bccd6d1ca7d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:15.040442 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea132284-0e33-4aad-95ba-0bccd6d1ca7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:15.040698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea132284-0e33-4aad-95ba-0bccd6d1ca7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:15.102054 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea132284-0e33-4aad-95ba-0bccd6d1ca7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:15.103483 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea132284-0e33-4aad-95ba-0bccd6d1ca7d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:15.112669 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1441/2853] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:15.405894 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:15.471202 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6090f6-ae3e-4195-a604-4315f26cf4d8 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:15.476271 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:15.477006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:15.477283 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:15.477585 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] PATH_INFO: `/v3/users/68e5e1c58e6a44a780416a040ca0f10a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:15.478730 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e5e1c58e6a44a780416a040ca0f10a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:15.480639 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:15.530835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e5e1c58e6a44a780416a040ca0f10a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:15.541088 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e5e1c58e6a44a780416a040ca0f10a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:15.541798 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e5e1c58e6a44a780416a040ca0f10a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:15.553796 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e5e1c58e6a44a780416a040ca0f10a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:15.554493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e5e1c58e6a44a780416a040ca0f10a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:15.566832 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1413/2854] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:15 2022] DELETE /identity/v3/users/68e5e1c58e6a44a780416a040ca0f10a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:15.571593 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:15.571881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:15.572157 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:15.593268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:15.594516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:15.656935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1442/2855] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:15.668872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:15.670457 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:15.736923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330b586-858d-4ea7-ad78-2574c590ae8e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:15.741961 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:15.742600 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:15.742885 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:15.743179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:15.752795 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:15.754254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:15.764452 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1414/2856] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:16.064355 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:16.065871 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:16.078268 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e6c6b-f6ac-4533-b5f9-cd099c738ff9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:16.083311 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:16.084074 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:16.084354 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:16.084622 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] PATH_INFO: `/v3/projects/9efaeb33189a42b9b358da0b5a9c2297` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:16.085978 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efaeb33189a42b9b358da0b5a9c2297)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:16.088137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:16.137290 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efaeb33189a42b9b358da0b5a9c2297', 'request_id': 'req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.143735 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efaeb33189a42b9b358da0b5a9c2297', 'request_id': 'req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.154606 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efaeb33189a42b9b358da0b5a9c2297', 'request_id': 'req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.169353 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] The token cache is being invalidate because project 9efaeb33189a42b9b358da0b5a9c2297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:16.169674 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.170399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.172347 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1443/2857] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:16 2022] DELETE /identity/v3/projects/9efaeb33189a42b9b358da0b5a9c2297 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:16.176097 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:16.186499 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d14ef0-0a10-4524-b92b-ef3906f6d615 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:16.195958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:16.251230 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:16.251905 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:16.252183 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:16.252458 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] PATH_INFO: `/v3/users/3fe3ecc3e08f4ba38252424500e072c5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:16.253752 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe3ecc3e08f4ba38252424500e072c5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:16.255724 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:16.305963 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe3ecc3e08f4ba38252424500e072c5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.315470 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe3ecc3e08f4ba38252424500e072c5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.316108 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe3ecc3e08f4ba38252424500e072c5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.328114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe3ecc3e08f4ba38252424500e072c5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.328746 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-465fc921-485c-42f4-a535-d3b629c4722e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe3ecc3e08f4ba38252424500e072c5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.340633 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1415/2858] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:16 2022] DELETE /identity/v3/users/3fe3ecc3e08f4ba38252424500e072c5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:16.626421 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:16.627984 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:16.638240 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:16.642401 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee6dfd-7300-43f8-b8ff-a5118a1b9c12 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:16.705612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:16.706201 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:16.706452 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:16.706720 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] PATH_INFO: `/v3/projects/e733f0bc344a4b1b9965ea42bab3ec9a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:16.707990 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e733f0bc344a4b1b9965ea42bab3ec9a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:16.709975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:16.765916 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e733f0bc344a4b1b9965ea42bab3ec9a', 'request_id': 'req-8951b33f-0aab-4be8-9fdc-291dc3e851d2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.773246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e733f0bc344a4b1b9965ea42bab3ec9a', 'request_id': 'req-8951b33f-0aab-4be8-9fdc-291dc3e851d2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.783974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e733f0bc344a4b1b9965ea42bab3ec9a', 'request_id': 'req-8951b33f-0aab-4be8-9fdc-291dc3e851d2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.796020 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] The token cache is being invalidate because project e733f0bc344a4b1b9965ea42bab3ec9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:16.796304 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.796918 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8951b33f-0aab-4be8-9fdc-291dc3e851d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:16.798438 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1444/2859] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:16 2022] DELETE /identity/v3/projects/e733f0bc344a4b1b9965ea42bab3ec9a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:16.803607 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e33f8-08c2-4df3-8c42-825e48cd7752 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:16.804092 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e33f8-08c2-4df3-8c42-825e48cd7752 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:16.804195 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e33f8-08c2-4df3-8c42-825e48cd7752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:16.826311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7b2e33f8-08c2-4df3-8c42-825e48cd7752 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:16.827521 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7b2e33f8-08c2-4df3-8c42-825e48cd7752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:16.897554 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1416/2860] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:16.906288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e866da-9069-4b2f-87ec-57a65140020d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:16.906557 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e866da-9069-4b2f-87ec-57a65140020d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:16.906872 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e866da-9069-4b2f-87ec-57a65140020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:16.928444 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c5e866da-9069-4b2f-87ec-57a65140020d None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:16.929673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c5e866da-9069-4b2f-87ec-57a65140020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:16.938363 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1445/2861] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:16.942621 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e33f8-08c2-4df3-8c42-825e48cd7752 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:16.952536 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e33f8-08c2-4df3-8c42-825e48cd7752 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:16.957254 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:16.957835 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:16.958100 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:16.958369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:16.959004 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:43:16.959304 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:16.960900 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:16.972671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1417/2862] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:43:16.977077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e866da-9069-4b2f-87ec-57a65140020d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:16.986845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e866da-9069-4b2f-87ec-57a65140020d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:16.991867 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:16.992470 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:16.992793 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:16.993127 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:16.993787 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:16.995725 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:17.027059 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1446/2863] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:16 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:17.033597 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:17.046380 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b533-23d6-4d62-a6bc-5c1c974f835e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:17.064820 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:17.106550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:17.107173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:17.107453 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:17.107723 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:17.108351 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:17.110344 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:17.134997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1418/2864] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:17 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:17.139340 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:17.149931 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a6f06-156d-405b-91cd-c4f7b4a330f5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:17.154782 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:17.155385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:17.155664 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:17.155935 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:17.156575 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:17.158217 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:17.168539 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1447/2865] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:17.172673 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:17.182728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b139a-f1e7-4aed-8af3-ac424742f653 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:17.188020 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16e8e4-b110-437a-8fe3-0b00c579c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:17.188616 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16e8e4-b110-437a-8fe3-0b00c579c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:17.188902 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16e8e4-b110-437a-8fe3-0b00c579c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:17.189285 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16e8e4-b110-437a-8fe3-0b00c579c4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:17.189971 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16e8e4-b110-437a-8fe3-0b00c579c4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:17.191586 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16e8e4-b110-437a-8fe3-0b00c579c4fb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:17.202327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1419/2866] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:17.206628 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:17.217183 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff372-153b-48c9-91a6-137289a8481f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:17.222614 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:17.223261 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:17.223536 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:17.223807 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] PATH_INFO: `/v3/projects/21704130a8304c519b801733a4cf1c58/users/11a6d10864244bf4a699f74e541c93a9/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:17.239034 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21704130a8304c519b801733a4cf1c58, user_id=11a6d10864244bf4a699f74e541c93a9, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:17.241689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:17.256855 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1448/2867] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:17 2022] PUT /identity/v3/projects/21704130a8304c519b801733a4cf1c58/users/11a6d10864244bf4a699f74e541c93a9/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:17.262320 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf36f8-578e-4f1d-a536-7ceedb1469f9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:17.262604 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf36f8-578e-4f1d-a536-7ceedb1469f9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:17.262876 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf36f8-578e-4f1d-a536-7ceedb1469f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:17.282966 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-69cf36f8-578e-4f1d-a536-7ceedb1469f9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:17.284315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-69cf36f8-578e-4f1d-a536-7ceedb1469f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:17.347845 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1420/2868] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:17.358295 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:17.360369 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:17.395109 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:17.427903 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e4471-4331-4fa3-a929-b4c5bee1acd1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:17.432974 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:17.433612 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:17.433893 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:17.434186 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:17.443738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:17.445192 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:17.454866 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1449/2869] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:18.124262 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b29a3-00a8-41e4-9c45-72e954a83983 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:18.125253 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b29a3-00a8-41e4-9c45-72e954a83983 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:18.125728 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b29a3-00a8-41e4-9c45-72e954a83983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:18.159012 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cf6b29a3-00a8-41e4-9c45-72e954a83983 None None] MFA Rules not processed for user `11a6d10864244bf4a699f74e541c93a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:18.160388 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cf6b29a3-00a8-41e4-9c45-72e954a83983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:18.230429 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1421/2870] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:18.235322 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:18.245845 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d1cfa-e98e-4d34-8261-6037ef740e38 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:18.251288 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:18.251929 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:18.252200 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:18.252472 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:18.253101 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:18.255068 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:18.295378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1450/2871] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:18 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:18.299386 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b29a3-00a8-41e4-9c45-72e954a83983 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:18.310860 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b29a3-00a8-41e4-9c45-72e954a83983 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:18.337260 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:18.369529 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:18.370169 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:18.370428 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:18.370721 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:18.371357 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:18.373379 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:18.395759 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1422/2872] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:18 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:18.400077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:18.410714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f7f6-080d-458b-921f-7b0070a2ce5d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:18.415945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:18.416522 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:18.416836 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:18.417117 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:18.417817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:18.419457 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:18.430608 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1451/2873] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:43:18.434828 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:18.445642 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d1579-f31d-4c2e-9798-e625a7ccf030 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:18.450779 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:18.451433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:18.451708 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:18.451983 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] PATH_INFO: `/v3/projects/bce72a5d3cdb45aa8810599e2f0b6deb/users/8538713fecb94e5090a003274541c73c/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:18.468296 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce72a5d3cdb45aa8810599e2f0b6deb, user_id=8538713fecb94e5090a003274541c73c, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:18.471137 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:18.488061 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1423/2874] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:18 2022] PUT /identity/v3/projects/bce72a5d3cdb45aa8810599e2f0b6deb/users/8538713fecb94e5090a003274541c73c/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:18.492248 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:18.502677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e48ee-0202-4121-8d70-bdce9514b412 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:18.564714 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51877-e99f-44fe-9a3e-2980761bc8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:18.565243 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51877-e99f-44fe-9a3e-2980761bc8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:18.565554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51877-e99f-44fe-9a3e-2980761bc8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:18.565830 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51877-e99f-44fe-9a3e-2980761bc8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:18.566479 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b51877-e99f-44fe-9a3e-2980761bc8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:18.568081 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b51877-e99f-44fe-9a3e-2980761bc8a4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:18.578210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1452/2875] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:18.582591 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:18.594823 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a259721-21d9-4995-a6ed-29f3ca76a756 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:18.603052 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015586d6-2ecc-4f89-b6e7-11923b7b07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:18.603696 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015586d6-2ecc-4f89-b6e7-11923b7b07a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:18.603974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015586d6-2ecc-4f89-b6e7-11923b7b07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:18.604242 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015586d6-2ecc-4f89-b6e7-11923b7b07a3 admin admin] PATH_INFO: `/v3/projects/bce72a5d3cdb45aa8810599e2f0b6deb/users/8538713fecb94e5090a003274541c73c/roles/1470302d39e340299072b424021b764b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:18.606482 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015586d6-2ecc-4f89-b6e7-11923b7b07a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce72a5d3cdb45aa8810599e2f0b6deb, user_id=8538713fecb94e5090a003274541c73c, role_id=1470302d39e340299072b424021b764b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:18.609125 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015586d6-2ecc-4f89-b6e7-11923b7b07a3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:18.619758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1424/2876] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:18 2022] PUT /identity/v3/projects/bce72a5d3cdb45aa8810599e2f0b6deb/users/8538713fecb94e5090a003274541c73c/roles/1470302d39e340299072b424021b764b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:19.271627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:19.272181 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:19.272346 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:19.301271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] MFA Rules not processed for user `8538713fecb94e5090a003274541c73c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:19.302524 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:19.377783 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1453/2877] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:19.389396 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ed78-bca4-4a9b-8b0e-bc7b47856940 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:19.389913 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ed78-bca4-4a9b-8b0e-bc7b47856940 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:19.390025 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ed78-bca4-4a9b-8b0e-bc7b47856940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:19.410306 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-dbe5ed78-bca4-4a9b-8b0e-bc7b47856940 None None] MFA Rules not processed for user `11a6d10864244bf4a699f74e541c93a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:19.411546 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dbe5ed78-bca4-4a9b-8b0e-bc7b47856940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:19.471178 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1425/2878] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:19.484738 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:19.486277 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:19.500563 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:19.565712 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081da2-7d10-421b-a913-f0f1b22401d2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:19.572465 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:19.573080 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:19.573359 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:19.573671 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:19.581630 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:19.583210 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:19.593291 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1454/2879] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:22.665692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ed78-bca4-4a9b-8b0e-bc7b47856940 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:22.730179 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ed78-bca4-4a9b-8b0e-bc7b47856940 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:22.733997 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:22.734712 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:22.734985 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:22.735433 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:22.737315 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:22.751350 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:22.752792 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:22.767524 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1426/2880] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:24.035496 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:24.045685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c1fca-1e40-450e-9f98-01bd269a3e89 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:24.049878 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:24.050490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:24.050766 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:24.051036 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:24.052949 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:24.068754 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:24.070234 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:24.082785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1455/2881] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:29.682920 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:29.684494 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:29.715847 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:29.745574 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b004a-1eca-441a-bd9d-fd73aa09ed80 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:29.749917 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913aaeebb773479e8c4cb64bb588fa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:29.750518 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:29.750841 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:29.751239 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:29.762660 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:29.764153 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:29.774014 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1427/2882] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:34.077077 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=34 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:39.769493 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=13 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:47.664224 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:47.665862 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:47.689476 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ec3c9-b11e-438c-bcab-4c6cf6fc0b18 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:47.696011 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0097046a5f7407d84884097fcfc4ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:47.697710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:47.697710 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:47.697964 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:47.700972 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:47.716069 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:47.718027 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:47.743975 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1456/2883] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:48.195511 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:48.197066 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:48.278091 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c20bd-dc2b-4f96-b8a8-07f996e21f1c service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:48.283445 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:48.284671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:48.284671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:48.284671 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:48.286408 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:48.298638 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:48.300249 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:48.311974 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1428/2884] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:48.875529 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:48.950643 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d84b4-e2ae-495b-9cb2-8d5534667406 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:48.955535 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:48.956171 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:48.956449 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:48.956724 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] PATH_INFO: `/v3/users/11a6d10864244bf4a699f74e541c93a9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:48.957868 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a6d10864244bf4a699f74e541c93a9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:48.959797 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:49.008825 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a6d10864244bf4a699f74e541c93a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.017677 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a6d10864244bf4a699f74e541c93a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.033594 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a6d10864244bf4a699f74e541c93a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.034875 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a6d10864244bf4a699f74e541c93a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.035716 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a6d10864244bf4a699f74e541c93a9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.056785 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1457/2885] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:48 2022] DELETE /identity/v3/users/11a6d10864244bf4a699f74e541c93a9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:49.240805 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:49.260649 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e451-da55-47ea-99bc-c2be8e419b19 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:49.322514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:49.323147 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:49.323422 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:49.323694 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] PATH_INFO: `/v3/projects/21704130a8304c519b801733a4cf1c58` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:49.325241 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21704130a8304c519b801733a4cf1c58)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:49.327216 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:49.378087 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21704130a8304c519b801733a4cf1c58', 'request_id': 'req-16608c50-65a0-49af-8083-ca5de45099b1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.392594 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21704130a8304c519b801733a4cf1c58', 'request_id': 'req-16608c50-65a0-49af-8083-ca5de45099b1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.402311 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21704130a8304c519b801733a4cf1c58', 'request_id': 'req-16608c50-65a0-49af-8083-ca5de45099b1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.414213 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] The token cache is being invalidate because project 21704130a8304c519b801733a4cf1c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:49.414495 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.415160 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.416619 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1429/2886] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:49 2022] DELETE /identity/v3/projects/21704130a8304c519b801733a4cf1c58 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:49.421071 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:49.423324 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:49.438460 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b028b99-7633-4c39-8007-d646b5a82952 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:49.499138 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:49.499813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:49.500089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:49.500373 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] PATH_INFO: `/v3/users/8538713fecb94e5090a003274541c73c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:49.501624 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8538713fecb94e5090a003274541c73c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:49.503627 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:49.510114 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:49.558939 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8538713fecb94e5090a003274541c73c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.567881 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8538713fecb94e5090a003274541c73c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.581227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8538713fecb94e5090a003274541c73c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.582005 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8538713fecb94e5090a003274541c73c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.582595 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88c9e552-2b72-4cf1-9b40-296ec6c50539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8538713fecb94e5090a003274541c73c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.596172 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1458/2887] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:49 2022] DELETE /identity/v3/users/8538713fecb94e5090a003274541c73c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:49.778441 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:49.780409 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:49.794760 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608c50-65a0-49af-8083-ca5de45099b1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:49.818173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:49.865810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:49.866471 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:49.866754 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:49.867028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] PATH_INFO: `/v3/projects/bce72a5d3cdb45aa8810599e2f0b6deb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:49.868173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce72a5d3cdb45aa8810599e2f0b6deb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:49.870414 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:49.922946 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce72a5d3cdb45aa8810599e2f0b6deb', 'request_id': 'req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.929432 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce72a5d3cdb45aa8810599e2f0b6deb', 'request_id': 'req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.941666 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce72a5d3cdb45aa8810599e2f0b6deb', 'request_id': 'req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.952454 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] The token cache is being invalidate because project bce72a5d3cdb45aa8810599e2f0b6deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:49.952678 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.953318 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4be5daff-60ea-4d81-a16a-4f985cc3dfa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:49.955042 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1430/2888] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:49 2022] DELETE /identity/v3/projects/bce72a5d3cdb45aa8810599e2f0b6deb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:49.959750 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc53e3-b29e-4e8b-9156-164c8df435e9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:49.960233 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc53e3-b29e-4e8b-9156-164c8df435e9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:49.960371 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc53e3-b29e-4e8b-9156-164c8df435e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:49.980505 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5fbc53e3-b29e-4e8b-9156-164c8df435e9 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:49.981753 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5fbc53e3-b29e-4e8b-9156-164c8df435e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:50.052298 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1459/2889] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:50.060402 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0c4a-ece9-459e-a7c5-90be339e2732 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.060688 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0c4a-ece9-459e-a7c5-90be339e2732 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.060960 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0c4a-ece9-459e-a7c5-90be339e2732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.084307 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f10f0c4a-ece9-459e-a7c5-90be339e2732 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:50.085844 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f10f0c4a-ece9-459e-a7c5-90be339e2732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:50.096857 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1431/2890] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:50.101279 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc53e3-b29e-4e8b-9156-164c8df435e9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:50.112819 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc53e3-b29e-4e8b-9156-164c8df435e9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:50.118404 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:50.119220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.119220 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.119550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.120385 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:43:50.120740 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:50.122378 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:50.145136 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1460/2891] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Aug 8 02:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:43:50.147016 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0c4a-ece9-459e-a7c5-90be339e2732 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:50.156573 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0c4a-ece9-459e-a7c5-90be339e2732 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:50.161415 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:50.162028 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.162309 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.162578 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.163201 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:50.165121 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:50.195293 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1432/2892] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Aug 8 02:43:50 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:50.199698 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:50.210926 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5d4d3-0dcf-494a-b5c9-d110d8243e3e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:50.271817 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:50.272510 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.272869 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.273215 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.274089 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:50.276540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:50.303809 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1461/2893] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Aug 8 02:43:50 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:43:50.305330 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:50.317065 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91442c-394e-4895-af43-0e820bebfc49 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:50.322949 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:50.323555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.323836 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.324180 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.324872 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:50.326700 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:50.341989 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1433/2894] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:50.343317 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:50.348894 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:50.358899 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99424e7-92bb-44cb-97a9-f28a27e0920d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:50.366116 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd5192-e118-4fc7-a30e-48ca99f30679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:50.366888 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5192-e118-4fc7-a30e-48ca99f30679 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.367227 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5192-e118-4fc7-a30e-48ca99f30679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.368399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5192-e118-4fc7-a30e-48ca99f30679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.368399 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd5192-e118-4fc7-a30e-48ca99f30679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:50.370249 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd5192-e118-4fc7-a30e-48ca99f30679 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:50.383434 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1462/2895] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Aug 8 02:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:43:50.388543 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:50.403685 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734db9-bbe3-40ef-b500-7f792074f1ca admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:50.411234 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:50.412172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.412714 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.413173 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] PATH_INFO: `/v3/projects/5abf8aaa76be469cb1ba473caeabbcd3/users/b1d4e963a42c471390d9d53a196705e9/roles/7322aadd09fa4f9fbb977a9ce8f9b768` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.436345 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abf8aaa76be469cb1ba473caeabbcd3, user_id=b1d4e963a42c471390d9d53a196705e9, role_id=7322aadd09fa4f9fbb977a9ce8f9b768)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:50.440681 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:50.459716 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1434/2896] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Aug 8 02:43:50 2022] PUT /identity/v3/projects/5abf8aaa76be469cb1ba473caeabbcd3/users/b1d4e963a42c471390d9d53a196705e9/roles/7322aadd09fa4f9fbb977a9ce8f9b768 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:50.470515 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.470891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.471244 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.507772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] MFA Rules not processed for user `b1d4e963a42c471390d9d53a196705e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:43:50.515469 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:50.586124 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1463/2897] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:43:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:43:50.597893 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:50.599623 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:50.653870 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:50.659791 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2e564-45f2-48a1-9cac-415454423238 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:50.665664 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d691f1a09e14fc5a1858b1ac3bdd026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:50.666462 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:50.666758 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:50.667082 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:50.676710 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:50.678269 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:50.688576 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1435/2898] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:58.292511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:58.294086 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:58.368008 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7b18-ac89-4d0e-9040-15b354483145 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:58.373128 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:58.373800 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:58.374158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:58.374474 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] PATH_INFO: `/v3/users/cb445433811d4f8a91eea8bcd0dced39` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:58.375609 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb445433811d4f8a91eea8bcd0dced39)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:58.377574 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:58.435143 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb445433811d4f8a91eea8bcd0dced39'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.443958 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb445433811d4f8a91eea8bcd0dced39'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.459550 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb445433811d4f8a91eea8bcd0dced39'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.460310 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb445433811d4f8a91eea8bcd0dced39'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.460917 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb445433811d4f8a91eea8bcd0dced39'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.469731 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:58.476214 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1464/2899] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:58 2022] DELETE /identity/v3/users/cb445433811d4f8a91eea8bcd0dced39 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:58.666419 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:58.680514 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00184-b627-4e98-9210-6ddc3af77c51 service glance] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:58.745324 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:58.746002 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:58.746275 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:58.746550 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] PATH_INFO: `/v3/projects/b1baccd19a294244a48fdf056d4ca597` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:58.747692 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1baccd19a294244a48fdf056d4ca597)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:58.749854 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:58.800149 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1baccd19a294244a48fdf056d4ca597', 'request_id': 'req-34029c10-04b3-442a-beec-d94bfd7bb8ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.806632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1baccd19a294244a48fdf056d4ca597', 'request_id': 'req-34029c10-04b3-442a-beec-d94bfd7bb8ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.816120 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1baccd19a294244a48fdf056d4ca597', 'request_id': 'req-34029c10-04b3-442a-beec-d94bfd7bb8ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.827412 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] The token cache is being invalidate because project b1baccd19a294244a48fdf056d4ca597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:58.827748 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.828367 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.829927 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1436/2900] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:58 2022] DELETE /identity/v3/projects/b1baccd19a294244a48fdf056d4ca597 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:58.834245 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:58.835689 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:58.849828 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ae982-4ae9-4783-94b1-6b8abfd288f8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:58.916516 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:58.917218 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:58.917541 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:58.917813 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] PATH_INFO: `/v3/users/ab8d56aeb00c45abb87a631e224236f8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:58.919016 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8d56aeb00c45abb87a631e224236f8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:58.921026 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:58.976450 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8d56aeb00c45abb87a631e224236f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.986100 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8d56aeb00c45abb87a631e224236f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.998945 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8d56aeb00c45abb87a631e224236f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:58.999911 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8d56aeb00c45abb87a631e224236f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:59.000554 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8d56aeb00c45abb87a631e224236f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:59.013629 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1465/2901] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:43:58 2022] DELETE /identity/v3/users/ab8d56aeb00c45abb87a631e224236f8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:43:59.208244 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:59.211526 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:59.232942 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34029c10-04b3-442a-beec-d94bfd7bb8ee admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:59.297466 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:59.298114 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:59.298532 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:59.298810 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] PATH_INFO: `/v3/projects/e97a9ed424f34ae48f5200fa985f1fc8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:59.299973 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97a9ed424f34ae48f5200fa985f1fc8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:59.301958 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:59.325952 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:59.354950 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97a9ed424f34ae48f5200fa985f1fc8', 'request_id': 'req-10daa50f-931f-4219-9b49-e53105a08587'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:59.361426 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97a9ed424f34ae48f5200fa985f1fc8', 'request_id': 'req-10daa50f-931f-4219-9b49-e53105a08587'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:59.371970 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97a9ed424f34ae48f5200fa985f1fc8', 'request_id': 'req-10daa50f-931f-4219-9b49-e53105a08587'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:59.383897 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] The token cache is being invalidate because project e97a9ed424f34ae48f5200fa985f1fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:43:59.384187 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:59.385027 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10daa50f-931f-4219-9b49-e53105a08587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:43:59.386555 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1437/2902] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:43:59 2022] DELETE /identity/v3/projects/e97a9ed424f34ae48f5200fa985f1fc8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:44:09.010122 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:09.380537 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:11.456540 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:44:11.458158 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:44:11.471619 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48a571-23e0-4ade-a63c-d2694ea2a430 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:44:11.536148 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:44:11.536772 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:44:11.537072 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:44:11.537325 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] PATH_INFO: `/v3/users/b1d4e963a42c471390d9d53a196705e9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:44:11.538560 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d4e963a42c471390d9d53a196705e9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:44:11.540490 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:44:11.595137 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d4e963a42c471390d9d53a196705e9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:11.606577 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d4e963a42c471390d9d53a196705e9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:11.619907 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d4e963a42c471390d9d53a196705e9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:11.620673 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d4e963a42c471390d9d53a196705e9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:11.621580 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d4e963a42c471390d9d53a196705e9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:11.635098 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1466/2903] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Aug 8 02:44:11 2022] DELETE /identity/v3/users/b1d4e963a42c471390d9d53a196705e9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:44:11.639632 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:44:11.640095 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:44:11.640204 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:44:11.659172 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] MFA Rules not processed for user `55725fd30c284e01b807aa482bab0655`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:44:11.660369 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:44:11.724492 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1438/2904] 10.222.0.25 () {58 vars in 958 bytes} [Mon Aug 8 02:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:44:11.734812 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:44:11.736414 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:44:11.797900 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc3a3-2a7b-41b0-8b80-07cb85b5e637 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:44:11.804010 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c5c41465004c0a81fced6e8834a5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:44:11.804910 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:44:11.805235 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:44:11.805649 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:44:11.819246 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:44:11.820685 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:44:11.830837 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1467/2905] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:44:12.122323 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:44:12.123923 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:44:12.136008 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd559db-9596-4f9e-bbf9-3f7d4dc9dd90 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:44:12.141006 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55725fd30c284e01b807aa482bab0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ce53165eb847a3be1e8ef59c28b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:44:12.142738 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:44:12.143055 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:44:12.143327 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] PATH_INFO: `/v3/projects/5abf8aaa76be469cb1ba473caeabbcd3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:44:12.144761 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abf8aaa76be469cb1ba473caeabbcd3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:44:12.147641 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:44:12.203789 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abf8aaa76be469cb1ba473caeabbcd3', 'request_id': 'req-63bc3317-08ce-4478-b5d4-60d5476e691b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:12.209806 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abf8aaa76be469cb1ba473caeabbcd3', 'request_id': 'req-63bc3317-08ce-4478-b5d4-60d5476e691b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:12.219128 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abf8aaa76be469cb1ba473caeabbcd3', 'request_id': 'req-63bc3317-08ce-4478-b5d4-60d5476e691b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:12.229975 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] The token cache is being invalidate because project 5abf8aaa76be469cb1ba473caeabbcd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:44:12.230252 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:12.231039 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-63bc3317-08ce-4478-b5d4-60d5476e691b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:44:12.232579 dv-cinder-733062-33-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1439/2906] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Aug 8 02:44:12 2022] DELETE /identity/v3/projects/5abf8aaa76be469cb1ba473caeabbcd3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:44:21.826511 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:22.227116 dv-cinder-733062-33-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:41.153763 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:46:41.155398 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:46:41.230429 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372859f-6e52-41d4-81a8-9d231993b209 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:46:41.294969 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd116-5f9f-4a35-ace6-fd91c80d2ca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624d4aaae75d49a59610ebc30d150f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed167140af4d4039b6aa4a7d0ef9cfd5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:46:41.295621 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd116-5f9f-4a35-ace6-fd91c80d2ca4 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:46:41.295891 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd116-5f9f-4a35-ace6-fd91c80d2ca4 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:46:41.296155 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd116-5f9f-4a35-ace6-fd91c80d2ca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:46:41.298271 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1dccd116-5f9f-4a35-ace6-fd91c80d2ca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:46:41.311061 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccd116-5f9f-4a35-ace6-fd91c80d2ca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:46:41.312648 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccd116-5f9f-4a35-ace6-fd91c80d2ca4 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:46:41.323835 dv-cinder-733062-33-smb devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1468/2907] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Aug 8 02:46:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:46:51.318996 dv-cinder-733062-33-smb devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=58 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}